-- Logs begin at Wed 2022-08-24 13:36:22 UTC, end at Wed 2022-08-24 15:02:23 UTC. -- Aug 24 14:24:59.478989 dv-cinder-756709-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:24:59.487908 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:24:59 2022] *** Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: nodename: dv-cinder-756709-6-iscsi Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: machine: x86_64 Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: clock source: unix Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: pcre jit disabled Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: detected number of CPU cores: 4 Aug 24 14:24:59.489956 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: current working directory: / Aug 24 14:24:59.490898 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:24:59.491136 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: your processes number limit is 47680 Aug 24 14:24:59.491136 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: your memory page size is 4096 bytes Aug 24 14:24:59.491136 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: detected max file descriptor number: 2048 Aug 24 14:24:59.491136 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: lock engine: pthread robust mutexes Aug 24 14:24:59.491468 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: thunder lock: enabled Aug 24 14:24:59.491551 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:24:59.491616 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:24:59.532623 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: Python main interpreter initialized at 0x560f2f7329c0 Aug 24 14:24:59.532623 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: python threads support enabled Aug 24 14:24:59.532623 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: your server socket listen backlog is limited to 100 connections Aug 24 14:24:59.532623 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:24:59.533177 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:24:59.533177 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: *** Operational MODE: preforking *** Aug 24 14:24:59.533361 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:24:59.533361 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: spawned uWSGI master process (pid: 106175) Aug 24 14:24:59.533566 dv-cinder-756709-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:24:59.535692 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: spawned uWSGI worker 1 (pid: 106184, cores: 1) Aug 24 14:24:59.535692 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: spawned uWSGI worker 2 (pid: 106185, cores: 1) Aug 24 14:24:59.536122 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:25:00.271748 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:25:00.378655 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:25:01.611382 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:25:01.611382 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: from cryptography.utils import int_from_bytes Aug 24 14:25:01.612195 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:25:01.612195 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: from cryptography.utils import int_from_bytes Aug 24 14:25:01.638033 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:25:01.638033 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: from cryptography.utils import int_from_bytes Aug 24 14:25:01.638961 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:25:01.638961 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: from cryptography.utils import int_from_bytes Aug 24 14:25:04.349807 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:25:04.350697 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:25:04.350831 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:25:04.351299 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:25:04.351622 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:25:04.352237 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.352790 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.353207 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.353600 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.354036 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.354425 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.354813 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.355209 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.355597 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.355920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.356420 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.356811 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-6-iscsi {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.357199 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.357567 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.357965 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.358489 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.358966 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.359442 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.359883 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.360616 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.361285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.361782 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.362266 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.362737 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.363190 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.363635 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.364188 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.364720 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.365251 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.365761 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.366485 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-6-iscsi {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.367056 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.368882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.368882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.369387 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.369825 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.370285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.370722 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.371251 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.371798 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.372346 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.372815 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.373277 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.373735 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.374190 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.374632 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.375083 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.375664 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.376170 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.376727 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.377169 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.377724 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.378346 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.378937 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.379526 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.379976 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.380326 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.380741 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.381181 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.381395 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:25:04.382234 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.382379 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:25:04.382508 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.382662 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:25:04.382806 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.382948 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:25:04.382948 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:25:04.383183 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.383340 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.383469 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.383691 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.383981 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.384160 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.384310 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.384538 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.384746 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.384998 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.385144 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.385382 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.385530 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.385687 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.385910 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.386116 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.386297 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.386490 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.386620 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.386924 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387072 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-6-iscsi {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387240 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387409 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387562 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387844 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.387981 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.388250 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.388466 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.388745 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.388879 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.389211 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.389384 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.389705 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.389850 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.390171 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.390506 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.390671 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391000 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391167 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391394 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391561 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391718 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.391888 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.392344 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.392499 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.392789 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.392963 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.393117 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.393392 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.393553 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.393702 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.393935 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.394105 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.394375 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.394550 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.394792 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-6-iscsi {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.394963 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.395108 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.395376 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.395532 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.395984 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.396200 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.396417 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.396680 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.396901 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.397093 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.397313 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.397522 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.397731 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.397949 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398119 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398243 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398405 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398550 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398695 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.398819 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.399583 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.399851 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.400081 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.400298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.400501 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.400821 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.400965 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401126 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401281 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401416 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401564 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401684 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.401890 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.402094 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.402220 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.402466 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.402625 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.402777 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403077 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403238 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403407 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403561 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403687 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.403899 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404073 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404211 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404394 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404535 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404815 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.404966 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.405119 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.405274 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.405420 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.405698 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.405844 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406044 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406317 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406456 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406584 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406794 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.406939 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407082 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407238 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407493 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407626 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407814 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.407965 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.408127 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.408367 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.408498 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.408816 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.408960 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.409094 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.409313 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.409471 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.409766 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.409903 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410136 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410428 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410614 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410786 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.410931 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.411213 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.411364 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.411582 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.411724 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.411876 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412089 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412250 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412429 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412573 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412769 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.412948 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.413073 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.413254 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.413442 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.413579 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.413867 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.414092 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.414296 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.414441 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.414799 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.414969 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.415225 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.415425 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.415806 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.415956 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.416247 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.416407 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.416669 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.416840 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.417074 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.417218 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.417538 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.417694 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.417971 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.418275 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.418458 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.418606 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.418995 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.419158 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.419308 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.419508 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.419646 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.419960 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.420102 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.420292 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.420519 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.420662 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.420915 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.421080 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.421203 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.421446 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.421594 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.421832 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.421977 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.422222 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.422362 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.422514 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.422820 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.423023 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.423165 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.423316 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.423519 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.423726 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.423874 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.424029 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.424265 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.424409 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.424631 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.424781 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.424932 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.425177 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.425346 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.425528 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.425673 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.425816 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.426146 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.426296 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.426464 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.426598 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.426828 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.427077 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.427295 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.427441 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.427599 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.427758 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.428000 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.428165 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.428322 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.428481 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.428608 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.428913 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.429075 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.429273 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.429485 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.429649 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.429793 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.430023 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.430729 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:25:04.431049 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.431389 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.431562 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.431734 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.432101 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.432269 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.432473 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.432641 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.432799 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433016 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433226 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433385 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433529 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433661 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.433963 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.434211 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.434373 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.434512 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.434664 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.434893 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435066 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435230 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435398 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435542 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435797 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.435968 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.436113 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.436284 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.436445 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.436730 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.436879 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.437035 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.437191 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.437392 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.437651 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.437812 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.438210 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.438388 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.438546 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.438691 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.438837 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.439086 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.439332 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.439583 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.439735 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.440036 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.440191 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.440472 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.440625 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.440920 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.441072 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.441218 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.441458 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.441629 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.441857 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.442139 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.442312 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.442497 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.442651 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.442901 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.443118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.443370 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.443584 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.443805 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.444030 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.444242 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.444481 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.444696 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.444924 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.445138 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.445138 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.445566 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.445873 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.446185 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.446356 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.446502 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.446659 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.446943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447097 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447097 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447375 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447580 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447742 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447910 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.447910 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448180 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448336 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448480 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448635 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448635 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.448981 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449187 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449187 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449470 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449615 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449778 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.449934 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450120 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450271 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450414 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450566 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450706 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.450912 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.451071 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.451232 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.451467 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.451767 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.451921 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.452195 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.452353 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.452496 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.452738 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.452973 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.453128 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.453271 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.453484 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.453691 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.453844 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454083 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454224 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454371 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454605 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454763 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.454921 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.455063 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.455214 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.455493 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.455649 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.455876 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456032 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456169 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456401 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456557 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456790 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.456877 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.457105 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.457322 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.457461 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.457802 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.457959 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.458130 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.458378 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.458547 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.458751 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.458895 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459067 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459293 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459445 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459663 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459819 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.459976 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.460187 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.460341 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.460540 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.460692 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.460995 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.461147 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.461883 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.462182 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.462384 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.462570 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.462731 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.462876 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463072 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463232 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463377 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463619 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463837 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.463984 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.464137 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.464280 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.464509 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.464672 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.464924 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.465076 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.465237 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.465430 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.465581 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.465855 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466040 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466287 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466456 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466599 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466742 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.466912 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.467169 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.467314 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.467631 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.467780 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.468092 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.468238 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.468501 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.468660 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.468812 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469058 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469218 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469418 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469563 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469825 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.469985 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.470291 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.470444 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.470808 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.470962 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.471235 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.471385 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.471562 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.471737 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.471987 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.472560 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.472718 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.472844 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.472990 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.473337 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.473511 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.473691 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.473902 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.474165 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.474328 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.474469 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.474621 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.474890 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475068 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475228 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475368 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475499 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475786 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.475953 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.476097 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.476313 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.476459 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.476696 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.476828 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.477148 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.477295 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.477479 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.477747 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.477909 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.478112 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.478343 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.478501 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.478719 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.478870 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.479076 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.479242 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.479422 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.479679 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.479835 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.480028 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.480171 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.480547 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.480717 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.480860 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481007 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481160 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481450 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481640 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481777 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.481951 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.482149 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.482364 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.482502 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.482696 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.482936 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.483125 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.483490 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.483703 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.483873 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.484024 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.484211 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.484478 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.484696 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.484919 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.485149 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.485366 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.485366 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.485778 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486047 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486258 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486488 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486668 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486801 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.486801 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.487299 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.487518 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.487737 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.487940 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488143 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488370 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488370 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488661 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488815 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.488955 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489096 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489096 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489383 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489383 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489634 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489777 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.489920 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.490134 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.490283 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.490577 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.490739 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.491047 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.491161 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.491488 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.491591 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.491983 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.492157 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.492303 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.492446 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.493193 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.493484 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.493635 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.493941 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.494164 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.494466 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.494645 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.494957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.495124 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.495464 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.495628 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.495957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.496119 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.496349 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.496523 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.496678 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.496951 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.497113 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.497278 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.497439 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.497601 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.497878 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.498089 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.498293 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.498455 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.498601 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.498850 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.499201 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.499358 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.499517 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.499741 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.499890 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.500176 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.500325 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.500694 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.500846 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.501247 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.501549 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.501847 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.502176 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.502470 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.502698 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.502987 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.503183 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.503516 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.503789 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.503945 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.504233 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.504407 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.504675 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.504830 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.505107 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.505260 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.505484 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.505740 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.506053 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.506312 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.506468 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.506749 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.506926 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.507110 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.507334 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.507593 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.507752 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.508008 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.508184 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.508631 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.508840 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.509097 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.509217 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.509500 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.509624 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.509947 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.510165 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.510326 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.510483 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.510627 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.510910 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511071 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511213 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511373 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511530 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511812 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.511979 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.512182 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.512415 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.512576 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.512762 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.512907 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.513157 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.513503 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.513656 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.513796 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.514053 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.514230 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.514446 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.514602 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.514764 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515212 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515378 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515619 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515781 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.515930 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.516110 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.516261 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.516528 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.516680 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.516821 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517062 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517215 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517419 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517722 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.517981 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.518178 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.518319 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.518482 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.518627 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.518936 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519229 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519393 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519550 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519680 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519813 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.519958 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.520080 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.520393 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.520540 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521069 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521236 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521384 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521520 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521687 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.521953 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.522138 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.522381 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.522588 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.522754 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.522912 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.523064 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.523212 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.523434 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.523553 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.523813 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.525389 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.525609 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.525764 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.525908 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526138 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526273 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526273 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526552 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526693 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526829 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526975 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.526975 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527245 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527383 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527505 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527646 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527646 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.527906 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528072 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528072 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528357 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528484 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528617 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528768 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.528920 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.529046 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.529180 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.529435 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.529620 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.529775 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.530043 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.530275 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.530500 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.530699 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.530908 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.531110 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.531314 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.531509 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.531723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.531924 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.532123 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.532331 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.532542 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.532695 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.532695 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.533059 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.533252 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.533539 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.533740 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.533955 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.534253 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.534462 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.534662 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.534662 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.535081 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.535288 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.535507 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.535734 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.535734 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.536098 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.536307 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.536513 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.536707 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.536908 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.537098 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.537098 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.537476 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.537689 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.537885 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538116 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538255 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538386 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538386 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538649 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538778 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.538907 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539039 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539171 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539525 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539710 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539842 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.539842 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.540085 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.540226 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.540226 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.540502 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.540843 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541003 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541137 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541137 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541425 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541557 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541702 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541843 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.541843 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542152 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542285 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542285 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542531 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542664 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542796 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542924 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.542924 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543137 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543264 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543395 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543523 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543673 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.543909 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544051 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544216 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544358 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544529 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544803 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.544989 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.545267 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.545424 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.545564 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.545797 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.545929 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.546182 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.546342 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.546477 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.546752 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.546959 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.547100 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.547233 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.547393 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.547652 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.547795 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.548086 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.548241 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.548408 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.548545 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.548718 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549017 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549213 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549354 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549729 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.549896 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.550122 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.550258 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.550528 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.550669 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.550807 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551009 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551175 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551417 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551564 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551717 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.551926 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.552067 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.552416 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.552562 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.552750 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.552889 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.553051 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.553346 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.553491 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.553769 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.553912 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.554096 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.554252 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.554407 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.554711 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.554855 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.555036 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.555804 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.555941 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557062 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557219 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557368 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557519 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557668 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557804 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557949 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.557949 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558333 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558448 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558565 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558711 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558711 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.558940 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559088 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559088 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559339 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559482 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559616 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.559733 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560026 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560175 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560340 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560545 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560687 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.560978 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.561118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.561280 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.561459 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.561618 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.561883 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562063 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562200 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562403 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562556 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562817 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.562960 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.563120 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.563333 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.563462 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.563729 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.563873 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.564036 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.564268 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.564407 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.564627 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.564867 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565005 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565332 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565485 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565620 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565752 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.565893 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.566181 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.566356 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.566512 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.566772 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.566998 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.567209 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.567405 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.567605 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.567796 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.568078 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.568078 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.568510 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.568721 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.568916 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569110 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569302 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569506 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569708 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569845 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.569845 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.570214 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.570360 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.570492 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.570618 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.570618 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.571520 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.571703 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.571854 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572003 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572139 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572289 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572289 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572535 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572535 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572778 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.572778 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573044 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573179 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573309 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573439 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573793 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.573935 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.574124 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.574321 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.574464 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.574704 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.574935 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.575077 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.575260 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.575413 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.575687 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.575828 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576008 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576220 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576368 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576607 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576757 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.576951 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.577138 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.577285 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.577531 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.577676 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.577815 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.578182 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.578326 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.578492 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.578632 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.578818 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.579086 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.579255 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.579473 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.579613 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.579791 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.580036 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.580224 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.580415 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.580594 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.580721 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.581053 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.581275 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.581475 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.581701 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.581917 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.582155 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.582373 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.582373 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.582801 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.582801 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.583175 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.583371 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.583560 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.583560 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.583948 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.584159 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.584356 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.584550 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.584753 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.584973 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585184 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585322 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585322 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585587 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585724 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.585935 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.586189 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.586189 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587162 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587313 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587461 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587632 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587779 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.587912 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588044 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588173 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588313 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588554 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588698 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.588924 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.589172 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.589323 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.589593 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.589740 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.589888 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.590173 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.590341 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.590528 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.590842 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591043 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591182 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591386 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591529 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591741 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.591895 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592032 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592295 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592439 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592641 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592806 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.592943 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.593221 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.593372 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.593517 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.593683 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.593829 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.594204 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.594355 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.594519 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.594654 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.594840 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.595129 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.595270 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.595453 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.595654 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.596032 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.596187 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.596324 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.596519 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.596650 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597006 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597160 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597364 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597524 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597655 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.597950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.598116 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.598305 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.598510 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.598658 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.598899 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.599039 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.599207 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.599515 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.599665 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.599802 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.600111 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.600275 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.600493 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.600636 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.600765 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.601003 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.601213 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.601352 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.601499 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.601883 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.602160 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.602429 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.602646 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.602783 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.602919 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603072 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603365 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603511 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603679 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603817 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.603986 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.604294 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.604435 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.604602 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.604787 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.604927 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.605215 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.605418 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.605568 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.605708 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.605845 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.606126 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.606285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.606422 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.606622 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.606820 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607017 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607149 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607327 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607572 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607727 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.607939 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608073 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608244 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608481 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608631 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608836 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.608988 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.609143 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.609446 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.609588 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.609727 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.609964 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.610151 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.610346 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.610501 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.610690 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.610946 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611083 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611264 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611460 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611611 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611831 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.611966 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.612137 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.612365 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.612527 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.612736 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.612885 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.613065 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.613315 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.613456 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.613724 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.613865 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614067 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614337 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614475 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614689 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614846 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.614986 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.615303 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.615498 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.615655 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.615798 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.615972 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.616232 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.616569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.616717 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.616903 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.617149 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.617301 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.617550 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.618309 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.618603 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.618744 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.618892 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619032 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619238 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619507 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619651 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619782 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.619929 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.620065 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.620263 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.620407 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.620572 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.620852 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621041 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621182 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621403 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621603 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621753 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.621885 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.622191 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.622450 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.622592 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.622801 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.622936 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.623091 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.623390 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.623665 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.623665 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.623921 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.624040 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.624289 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.624424 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.624647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.624878 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.625042 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.625273 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.625472 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.625625 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.625889 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.626097 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.626251 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.626483 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.626641 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.626790 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.627028 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.627241 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.627404 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.627555 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.627737 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628006 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628143 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628342 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628477 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628782 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.628924 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.629091 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.629356 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.629504 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.629719 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.629886 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.630075 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.630368 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.630531 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.630703 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.630936 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.631117 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.631289 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.631564 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.631765 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.631902 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.632039 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.632270 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.632479 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.632668 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.632857 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.633057 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.633318 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634095 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634234 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634368 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634506 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634708 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.634834 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.635028 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.635224 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.635361 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.635628 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.635931 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.636072 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.636235 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.636453 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.636590 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.636886 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.637077 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.637266 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.637418 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.637568 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.637719 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.638044 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.638272 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.638468 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.638660 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.638868 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.639071 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.639276 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.639276 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.639665 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.639870 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.640065 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.640254 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.640549 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.640745 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.640745 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.641112 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.641364 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.641554 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.641775 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.641981 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642195 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642195 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642447 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642597 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642735 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642884 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.642884 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643133 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643270 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643270 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643545 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643684 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643824 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.643956 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644095 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644247 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644370 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644602 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644744 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.644944 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.645174 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.645311 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.645525 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646039 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646167 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646382 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646527 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646710 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.646845 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647025 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647294 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647425 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647644 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647779 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.647949 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.648223 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.648375 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.648573 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.648702 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649077 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649243 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649361 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649653 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649802 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.649984 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.650314 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.650469 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.650639 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.650786 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.650932 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.651235 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.651441 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.651599 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.651795 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.651934 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.652164 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.652335 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.652467 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.652738 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.652877 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.653050 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.653285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.653427 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.653693 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.653827 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.654079 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.654350 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.654479 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.654676 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655033 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655205 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655350 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655611 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655740 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.655992 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.656140 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.656304 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.656615 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.656749 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.656915 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.657120 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.657258 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:25:04.657576 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.657974 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.658508 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.658890 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.659273 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.659659 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.660054 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.660433 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.660850 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.661232 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.661662 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.662166 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.662574 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.663226 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.663647 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.664039 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.664440 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.665592 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.666114 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.666541 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.666946 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.667331 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.667716 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.668109 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.668535 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.668937 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.669320 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.669710 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.670136 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.670521 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.670906 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.671285 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.671697 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.672126 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.672577 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.672963 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.673351 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.673735 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.674157 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.674541 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.674922 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.675310 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.675734 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.676118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.676499 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.676900 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.677280 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.677669 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.678087 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.678494 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.678943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.679364 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.679827 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.680777 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.681184 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.681573 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.681985 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.682509 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.682947 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.683625 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.684034 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.684427 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.684838 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.685274 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.685725 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.686162 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.686556 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.686957 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.687339 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.687724 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.688119 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.688501 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.688920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.689416 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.689806 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.690225 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.690608 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.690991 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.691369 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.691748 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.692134 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.692555 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.692998 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.693426 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.693821 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.694279 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.694696 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.695087 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.695473 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.695990 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.696513 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.696905 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.697299 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.697711 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.698140 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.698531 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.699064 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.699479 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.699875 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.700272 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.700658 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.701107 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.701540 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.701928 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.702385 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.702800 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.703229 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.703692 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.704099 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.704500 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.704883 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.705275 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.705677 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.706097 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.706586 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.706975 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.707349 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.707752 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.708136 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.708513 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.708901 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.709342 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.709743 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.710176 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.710555 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.710928 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.711307 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.711733 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.712131 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.712511 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.712942 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.713364 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.713759 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.714186 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.714567 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.714941 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.715356 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.715764 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.716151 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.716544 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.716984 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.717385 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.717797 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.718239 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.718644 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.719048 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.719457 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.719887 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.720269 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.720653 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.721037 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.721438 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.721867 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.722290 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.722707 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.723169 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.723654 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.724060 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.724465 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.724868 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.725265 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.725654 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.726106 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.726499 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.727478 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.728013 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.728269 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.728739 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.729246 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.729685 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.730153 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.730550 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.730939 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.731347 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.731748 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.732133 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.732535 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.732948 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.733406 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.733920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.734307 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.734771 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.735175 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.735561 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.735942 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:25:04.736255 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:25:04.815338 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO dbcounter [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Registered counter for database nova_api Aug 24 14:25:04.842256 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_db.sqlalchemy.engines [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:04.854820 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writer thread running {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:04.893638 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO dbcounter [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Registered counter for database nova_api Aug 24 14:25:04.921888 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.context [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b63dd42d-f9d6-49b8-bedc-eb04d541d366(cell1) {{(pid=106185) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:25:04.922423 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:04.926104 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:25:04.926589 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:25:04.928243 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:25:04.929034 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:25:04.929482 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:25:04.931251 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writer thread running {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:04.933668 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:25:04.936402 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO dbcounter [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Registered counter for database nova_cell0 Aug 24 14:25:04.942598 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO dbcounter [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Registered counter for database nova_cell1 Aug 24 14:25:04.952986 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_db.sqlalchemy.engines [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:04.955442 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_db.sqlalchemy.engines [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:04.965204 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writer thread running {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:04.966803 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writer thread running {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:04.998190 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.context [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b63dd42d-f9d6-49b8-bedc-eb04d541d366(cell1) {{(pid=106184) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:25:05.002373 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:25:05.002888 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:25:05.004549 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:25:05.005347 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:25:05.005799 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:25:05.007900 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_concurrency.lockutils [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:25:05.010659 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO dbcounter [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Registered counter for database nova_cell0 Aug 24 14:25:05.016971 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO dbcounter [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Registered counter for database nova_cell1 Aug 24 14:25:05.027463 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:05.029864 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:05.039313 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writer thread running {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:05.040019 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writer thread running {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:05.137477 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO dbcounter [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Registered counter for database nova_cell0 Aug 24 14:25:05.150897 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_db.sqlalchemy.engines [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:05.158762 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writer thread running {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:05.197346 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO dbcounter [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Registered counter for database nova_cell0 Aug 24 14:25:05.208267 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:25:05.214428 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writer thread running {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:25:05.716740 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: WARNING keystonemiddleware.auth_token [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:25:05.730315 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: WARNING keystonemiddleware.auth_token [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:25:05.805923 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: WARNING keystonemiddleware.auth_token [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:25:05.819292 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: WARNING keystonemiddleware.auth_token [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:25:06.175193 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: WARNING keystonemiddleware.auth_token [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:25:06.182870 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: WARNING keystonemiddleware.auth_token [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:25:06.188898 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560f2f7329c0 pid: 106185 (default app) Aug 24 14:25:06.191504 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:25:06.193068 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002302 Aug 24 14:25:06.193649 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Aug 24 14:25:06 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:25:06.239919 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: WARNING keystonemiddleware.auth_token [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:25:06.247219 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: WARNING keystonemiddleware.auth_token [None req-5f0cdee6-5b1e-42a2-8399-4e6c29f72a63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:25:06.253002 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560f2f7329c0 pid: 106184 (default app) Aug 24 14:26:46.525436 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:26:46.527265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Aug 24 14:26:46.530568 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:26:46.545765 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_api:SELECT=3 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:46.547442 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_cell0:SELECT=3 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:46.548547 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_cell1:SELECT=3 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:46.549615 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:47.716580 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-3adcbcdc-e333-4304-8c99-6eee3ad27a05 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:26:47.779268 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-3adcbcdc-e333-4304-8c99-6eee3ad27a05 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.243205 Aug 24 14:26:47.780504 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 14:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:26:50.986456 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:26:50.988136 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-2dac4ae4-9f5e-4dd3-8b53-8bf25a99d7cd None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002500 Aug 24 14:26:50.989691 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:26:51.625415 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-315fc9aa-b9c8-416f-8aed-799980e15dfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:26:51.683074 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:26:51.683074 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: warnings.warn(msg) Aug 24 14:26:52.022264 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-315fc9aa-b9c8-416f-8aed-799980e15dfb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 1.024200 Aug 24 14:26:52.022788 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:26:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:26:52.380143 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-32947bb6-42f0-4815-80eb-8972080e7d54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:26:52.386461 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:26:52.386461 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:26:52.420293 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=3 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:52.424438 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_cell1:SELECT=3 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:52.426778 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_cell0:SELECT=3 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:52.429097 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:26:52.575214 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-32947bb6-42f0-4815-80eb-8972080e7d54 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.537883 Aug 24 14:26:52.575214 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 14:26:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:26:55.770620 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-315fc9aa-b9c8-416f-8aed-799980e15dfb admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:26:55.772392 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-315fc9aa-b9c8-416f-8aed-799980e15dfb admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002599 Aug 24 14:26:55.773117 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:26:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:26:57.091455 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-ca7e8a4e-a6cd-4d88-b7b6-0b5e7d064dec admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:26:57.122244 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:26:57.122244 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:26:57.254053 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-ca7e8a4e-a6cd-4d88-b7b6-0b5e7d064dec admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.469822 Aug 24 14:26:57.255578 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:26:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:26:57.272159 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-eeea5b83-d6a4-4982-a4ae-b324c3392d5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:26:57.276023 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:26:57.276023 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: warnings.warn(msg) Aug 24 14:26:57.427472 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-eeea5b83-d6a4-4982-a4ae-b324c3392d5d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159461 Aug 24 14:26:57.438890 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 14:26:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:27:00.718997 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-ca7e8a4e-a6cd-4d88-b7b6-0b5e7d064dec admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:00.720028 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-ca7e8a4e-a6cd-4d88-b7b6-0b5e7d064dec admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 14:27:00.720431 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:01.367114 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-b42a110c-7663-4838-84cf-6c4fe0b98cf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "d2", "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:01.456898 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-b42a110c-7663-4838-84cf-6c4fe0b98cf0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.729322 Aug 24 14:27:01.458207 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:27:01.471287 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-79bbeb30-c080-4f9c-aeda-a23f323b6673 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:01.569295 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-79bbeb30-c080-4f9c-aeda-a23f323b6673 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101824 Aug 24 14:27:01.569906 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 14:27:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:04.844119 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-b42a110c-7663-4838-84cf-6c4fe0b98cf0 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:04.845844 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-b42a110c-7663-4838-84cf-6c4fe0b98cf0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Aug 24 14:27:04.846364 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:05.442461 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-62527004-9243-44b4-a998-406fe988f85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "ram": 2048, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:05.510259 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-62527004-9243-44b4-a998-406fe988f85b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.655460 Aug 24 14:27:05.511770 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:27:05.530858 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-e84d6e66-c1a6-41ce-9367-2dfd9490aa81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:05.620501 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-e84d6e66-c1a6-41ce-9367-2dfd9490aa81 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096059 Aug 24 14:27:05.621487 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 14:27:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:09.058225 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-62527004-9243-44b4-a998-406fe988f85b admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:09.059380 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-62527004-9243-44b4-a998-406fe988f85b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 24 14:27:09.060122 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:09.729182 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:09.840022 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.771018 Aug 24 14:27:09.841695 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:27:09.856073 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-96b63ffb-bff2-4e3e-ad4d-b8bd365e9425 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:10.030977 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-96b63ffb-bff2-4e3e-ad4d-b8bd365e9425 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.178345 Aug 24 14:27:10.031944 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 14:27:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:13.203702 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:13.205004 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Aug 24 14:27:13.205550 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:13.838505 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-ee69f7c4-0baf-49e2-8f69-2996545e5de3 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:13.890503 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-ee69f7c4-0baf-49e2-8f69-2996545e5de3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.675797 Aug 24 14:27:13.891591 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 14:27:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:16.635959 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:16.637159 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-741e4759-5aea-4a4f-92a6-129d9699b802 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Aug 24 14:27:16.637813 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:17.169542 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-69446f77-9d9e-4af4-8edb-baaf8ca87961 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:17.291193 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-69446f77-9d9e-4af4-8edb-baaf8ca87961 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.644723 Aug 24 14:27:17.294739 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:27:17.305737 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-03da102f-e24c-4fad-8f64-2e831b564d4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:17.311184 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:27:17.399537 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-03da102f-e24c-4fad-8f64-2e831b564d4a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093055 Aug 24 14:27:17.399537 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 14:27:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:20.280661 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-69446f77-9d9e-4af4-8edb-baaf8ca87961 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:20.281820 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-69446f77-9d9e-4af4-8edb-baaf8ca87961 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Aug 24 14:27:20.282955 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:21.134150 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-7035fe5a-598c-4328-b36c-b8f39daef142 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:21.384549 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-7035fe5a-598c-4328-b36c-b8f39daef142 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.093375 Aug 24 14:27:21.385436 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:27:21.404339 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-61b40f4d-a4c5-439c-b92f-80da7e64d33e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:21.546640 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-61b40f4d-a4c5-439c-b92f-80da7e64d33e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148691 Aug 24 14:27:21.547639 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 14:27:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:24.394562 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-7035fe5a-598c-4328-b36c-b8f39daef142 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:24.396438 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-7035fe5a-598c-4328-b36c-b8f39daef142 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002343 Aug 24 14:27:24.402800 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:25.136330 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-16ad8c19-00c8-44af-a53c-42971dc72846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:25.245078 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-16ad8c19-00c8-44af-a53c-42971dc72846 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.839981 Aug 24 14:27:25.259147 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:27:25.271176 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-4faf05dc-8de9-4410-9d43-f5be5328f4dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:25.472291 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-4faf05dc-8de9-4410-9d43-f5be5328f4dd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.207420 Aug 24 14:27:25.473654 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 14:27:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:28.295084 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-16ad8c19-00c8-44af-a53c-42971dc72846 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:28.296994 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-16ad8c19-00c8-44af-a53c-42971dc72846 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002659 Aug 24 14:27:28.297953 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:28.963140 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-932213a4-095f-4848-8210-5652100fb0c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "swap": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:29.106754 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-932213a4-095f-4848-8210-5652100fb0c3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.799509 Aug 24 14:27:29.114585 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:27:29.126786 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-ceee3d87-9d7c-44dc-b159-e1aeb2861d40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:29.134598 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:27:29.238857 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-ceee3d87-9d7c-44dc-b159-e1aeb2861d40 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118012 Aug 24 14:27:29.240236 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 14:27:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:32.184497 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-932213a4-095f-4848-8210-5652100fb0c3 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:32.186368 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-932213a4-095f-4848-8210-5652100fb0c3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Aug 24 14:27:32.186806 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:32.813874 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:32.945829 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.751590 Aug 24 14:27:32.946787 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 14:27:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:27:32.959917 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-fb73ac4e-c9c8-4723-8c0d-234ba1f77666 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:33.128522 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-fb73ac4e-c9c8-4723-8c0d-234ba1f77666 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.172284 Aug 24 14:27:33.129348 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 14:27:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:27:51.412703 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:51.413806 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 24 14:27:51.414361 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:51.427802 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:27:52.001608 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-7a83a5a7-d232-4ecf-9b32-cf0fcb2cd395 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:52.022128 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-7a83a5a7-d232-4ecf-9b32-cf0fcb2cd395 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.599721 Aug 24 14:27:52.022687 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 14:27:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:53.219609 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:53.220881 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-46389880-5241-4eae-93a4-b9a183225c96 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 24 14:27:53.221374 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:53.920689 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-12cb1061-88ed-4f68-854d-4cd6c7b8b8ca admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:53.931865 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.wsgi [None req-12cb1061-88ed-4f68-854d-4cd6c7b8b8ca admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-12cb1061-88ed-4f68-854d-4cd6c7b8b8ca admin admin] Request method failure captured: Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept: application/json Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept-Encoding: gzip, deflate Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Connection: keep-alive Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Content-Length: 0 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Host: 10.222.0.49 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-System-Scope: None Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: User-Agent: python-novaclient Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Auth-Token: gAAAAABjBjVponpQ3Fm0-56leNCz7daSo8fnk_ntb-O9y0nP6RsPQTUJgd_ucuWTKqrywfCFADrpURm_8NfF5lyEGtImQBuk0pDizHo99KpgpSpb-Plk0iD84tz1jWDE5sOXI6QuDNfmznUhqQGsyjsusdjC5pXrh0txO-p44-0giHk9zA7MyyY Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Id: None Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Name: None Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Identity-Status: Confirmed Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Is-Admin-Project: True Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Id: default Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Name: Default Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Name: admin Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Role: reader,admin,member Aug 24 14:27:53.938340 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Roles: reader,admin,member Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant: admin Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Name: admin Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User: admin Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Id: default Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Name: Default Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Name: admin Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: method: > Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: exception: Flavor 42 could not be found. Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: action_args: {'id': '42'} Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:53.940475 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:53.941571 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:53.942859 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-12cb1061-88ed-4f68-854d-4cd6c7b8b8ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:53.943920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-12cb1061-88ed-4f68-854d-4cd6c7b8b8ca admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.576469 Aug 24 14:27:53.943920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 14:27:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 578 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:27:53.953005 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-fe067ddd-c6bf-4dba-bc55-1518aa866733 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:53.957597 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:27:53.977644 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-fe067ddd-c6bf-4dba-bc55-1518aa866733 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028195 Aug 24 14:27:53.978280 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:53.989196 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-90347637-bcd4-44ec-b198-4c8ede9cdf4d admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:54.014839 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-90347637-bcd4-44ec-b198-4c8ede9cdf4d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029916 Aug 24 14:27:54.015445 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:54.026457 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-b4929008-bcf2-451c-95b2-16ecd5efd71f admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:54.033248 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.wsgi [None req-b4929008-bcf2-451c-95b2-16ecd5efd71f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-b4929008-bcf2-451c-95b2-16ecd5efd71f admin admin] Request method failure captured: Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept: application/json Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept-Encoding: gzip, deflate Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Connection: keep-alive Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Content-Length: 0 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Host: 10.222.0.49 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-System-Scope: None Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: User-Agent: python-novaclient Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Auth-Token: gAAAAABjBjVponpQ3Fm0-56leNCz7daSo8fnk_ntb-O9y0nP6RsPQTUJgd_ucuWTKqrywfCFADrpURm_8NfF5lyEGtImQBuk0pDizHo99KpgpSpb-Plk0iD84tz1jWDE5sOXI6QuDNfmznUhqQGsyjsusdjC5pXrh0txO-p44-0giHk9zA7MyyY Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Id: None Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Name: None Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Identity-Status: Confirmed Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Is-Admin-Project: True Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Id: default Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Name: Default Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Name: admin Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Role: reader,admin,member Aug 24 14:27:54.036647 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Roles: reader,admin,member Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant: admin Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Name: admin Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User: admin Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Id: default Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Name: Default Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Name: admin Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: method: > Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: exception: Flavor 42 could not be found. Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: action_args: {'id': '42'} Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:54.046109 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:54.047692 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:54.050388 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-b4929008-bcf2-451c-95b2-16ecd5efd71f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:54.052487 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-b4929008-bcf2-451c-95b2-16ecd5efd71f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016064 Aug 24 14:27:54.052487 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 14:27:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 14:27:55.183589 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-90347637-bcd4-44ec-b198-4c8ede9cdf4d admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:55.184643 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-90347637-bcd4-44ec-b198-4c8ede9cdf4d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 14:27:55.185049 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:27:55.823245 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-0a955b66-b637-4818-9136-4ac1f5f41c3c admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:55.833478 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.wsgi [None req-0a955b66-b637-4818-9136-4ac1f5f41c3c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-0a955b66-b637-4818-9136-4ac1f5f41c3c admin admin] Request method failure captured: Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept: application/json Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept-Encoding: gzip, deflate Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Connection: keep-alive Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Content-Length: 0 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Host: 10.222.0.49 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-System-Scope: None Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: User-Agent: python-novaclient Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Auth-Token: gAAAAABjBjVqUcp6CrY3xpCIeCxs3TmasJCWsUf0mrU6JLR1XaRfTdMvTITYHniYe8F4uJa1ZV1lOL_NIDnqdQ3cs_oMP16D6Bj6RvC1ceVyGBW5jdipU87pYMITMfS8T0CwWEoBe3VrCBQAwv3bU60v76Xp0c187BqyGrzX-KtoIxzPGYi_1mA Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Id: None Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Name: None Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Identity-Status: Confirmed Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Is-Admin-Project: True Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Id: default Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Name: Default Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Name: admin Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Role: reader,admin,member Aug 24 14:27:55.836569 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Roles: reader,admin,member Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant: admin Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Name: admin Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User: admin Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Id: default Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Name: Default Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Name: admin Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: method: > Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: exception: Flavor 84 could not be found. Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: action_args: {'id': '84'} Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:55.838141 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:55.838950 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.840045 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-0a955b66-b637-4818-9136-4ac1f5f41c3c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:55.841361 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-0a955b66-b637-4818-9136-4ac1f5f41c3c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.510689 Aug 24 14:27:55.841361 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 14:27:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:27:55.851226 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-c9c77d3e-1a09-4fc2-9634-f8f74d77c643 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:55.867672 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-c9c77d3e-1a09-4fc2-9634-f8f74d77c643 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020179 Aug 24 14:27:55.868261 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:27:55.880694 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-d6fece65-4e7d-4d6f-b6e4-87a900981309 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:55.899928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-d6fece65-4e7d-4d6f-b6e4-87a900981309 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024710 Aug 24 14:27:55.904496 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:55.911241 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-183529f8-3bed-46bd-b673-3c632958f828 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:55.918174 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.wsgi [None req-183529f8-3bed-46bd-b673-3c632958f828 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-183529f8-3bed-46bd-b673-3c632958f828 admin admin] Request method failure captured: Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept: application/json Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept-Encoding: gzip, deflate Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Connection: keep-alive Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Content-Length: 0 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Host: 10.222.0.49 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-System-Scope: None Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: User-Agent: python-novaclient Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Auth-Token: gAAAAABjBjVqUcp6CrY3xpCIeCxs3TmasJCWsUf0mrU6JLR1XaRfTdMvTITYHniYe8F4uJa1ZV1lOL_NIDnqdQ3cs_oMP16D6Bj6RvC1ceVyGBW5jdipU87pYMITMfS8T0CwWEoBe3VrCBQAwv3bU60v76Xp0c187BqyGrzX-KtoIxzPGYi_1mA Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Id: None Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Name: None Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Identity-Status: Confirmed Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Is-Admin-Project: True Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Id: default Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Name: Default Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Name: admin Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Role: reader,admin,member Aug 24 14:27:55.921298 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Roles: reader,admin,member Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant: admin Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Name: admin Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User: admin Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Id: default Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Name: Default Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Name: admin Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: method: > Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: exception: Flavor 84 could not be found. Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: action_args: {'id': '84'} Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:55.922882 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:55.923943 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:55.925380 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-183529f8-3bed-46bd-b673-3c632958f828 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:55.926603 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-183529f8-3bed-46bd-b673-3c632958f828 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016176 Aug 24 14:27:55.926603 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 14:27:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:27:57.242839 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-d6fece65-4e7d-4d6f-b6e4-87a900981309 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:57.243873 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-d6fece65-4e7d-4d6f-b6e4-87a900981309 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 24 14:27:57.244291 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:57.946093 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-2ed38fd9-e3cf-4437-bb43-1e2e572c5d79 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:57.954231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.wsgi [None req-2ed38fd9-e3cf-4437-bb43-1e2e572c5d79 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-2ed38fd9-e3cf-4437-bb43-1e2e572c5d79 admin admin] Request method failure captured: Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept: application/json Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Accept-Encoding: gzip, deflate Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Connection: keep-alive Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Content-Length: 0 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Host: 10.222.0.49 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Openstack-System-Scope: None Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: User-Agent: python-novaclient Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Auth-Token: gAAAAABjBjVtpwGfpmJgP5NF4_g0z5DEORyFfiD8gXSsMl3DKXMZPLw_IvR2UMW6cpwGnh05H3rbxXCE_0ePpLIUn8PeKGapJ8z10obWFFN_JuvKoI3iA8QLRHbhGMgvR7kpTWL7781o4GHq2_YKLmNvAmsyhV2uPOUUE-OjKjhqlt38JSxHZ9U Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Id: None Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Domain-Name: None Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Identity-Status: Confirmed Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Is-Admin-Project: True Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Id: default Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Domain-Name: Default Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Project-Name: admin Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Role: reader,admin,member Aug 24 14:27:57.957118 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Roles: reader,admin,member Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant: admin Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-Tenant-Name: admin Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User: admin Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Id: default Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Domain-Name: Default Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: X-User-Name: admin Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: method: > Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: exception: Flavor 451 could not be found. Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: action_args: {'id': '451'} Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:57.959464 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:57.961231 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: ERROR nova.api.openstack.wsgi Aug 24 14:27:57.963723 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-2ed38fd9-e3cf-4437-bb43-1e2e572c5d79 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:57.966148 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-2ed38fd9-e3cf-4437-bb43-1e2e572c5d79 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.570050 Aug 24 14:27:57.966148 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:27:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:27:57.973593 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-193de5b3-32a2-4b9c-85ff-57a07891c483 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:57.990517 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-193de5b3-32a2-4b9c-85ff-57a07891c483 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021698 Aug 24 14:27:57.991103 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:58.001495 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:58.018546 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020568 Aug 24 14:27:58.019141 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 14:27:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:27:58.029115 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-d0a3af98-5cab-4e0b-bb11-f21f04204758 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:58.035673 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.wsgi [None req-d0a3af98-5cab-4e0b-bb11-f21f04204758 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-d0a3af98-5cab-4e0b-bb11-f21f04204758 admin admin] Request method failure captured: Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept: application/json Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Accept-Encoding: gzip, deflate Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Connection: keep-alive Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Content-Length: 0 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Host: 10.222.0.49 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-Api-Version: compute 2.90 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Openstack-System-Scope: None Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: User-Agent: python-novaclient Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Auth-Token: gAAAAABjBjVtpwGfpmJgP5NF4_g0z5DEORyFfiD8gXSsMl3DKXMZPLw_IvR2UMW6cpwGnh05H3rbxXCE_0ePpLIUn8PeKGapJ8z10obWFFN_JuvKoI3iA8QLRHbhGMgvR7kpTWL7781o4GHq2_YKLmNvAmsyhV2uPOUUE-OjKjhqlt38JSxHZ9U Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Id: None Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Domain-Name: None Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Identity-Status: Confirmed Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Is-Admin-Project: True Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Id: default Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Domain-Name: Default Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Project-Name: admin Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Role: reader,admin,member Aug 24 14:27:58.037272 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Roles: reader,admin,member Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f90d0e4c756a418fb562e2e8abdd6ef4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f90d0e4c756a418fb562e2e8abdd6ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant: admin Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Id: f90d0e4c756a418fb562e2e8abdd6ef4 Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-Tenant-Name: admin Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User: admin Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Id: default Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Domain-Name: Default Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Id: 34ed7567d900480cb00efd1e75c2ddc5 Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: X-User-Name: admin Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: method: > Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: exception: Flavor 451 could not be found. Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: action_args: {'id': '451'} Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:27:58.039957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:58.041928 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: ERROR nova.api.openstack.wsgi Aug 24 14:27:58.044265 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-d0a3af98-5cab-4e0b-bb11-f21f04204758 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:27:58.046398 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-d0a3af98-5cab-4e0b-bb11-f21f04204758 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013512 Aug 24 14:27:58.046398 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:27:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:27:59.195896 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:27:59.196971 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 14:27:59.197441 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:27:59.837933 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-44fd4f10-4f42-416a-be5c-9dcac64b8d17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:27:59.956999 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-44fd4f10-4f42-416a-be5c-9dcac64b8d17 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.607520 Aug 24 14:27:59.957612 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 14:27:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:28:01.015983 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:28:01.017151 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Aug 24 14:28:01.018170 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:28:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:28:01.942292 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-16d4af14-4330-4934-9b33-6499cd4e792c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:28:02.030294 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-16d4af14-4330-4934-9b33-6499cd4e792c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.742251 Aug 24 14:28:02.030861 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 14:28:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:28:03.128104 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:28:03.129141 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002376 Aug 24 14:28:03.129576 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:28:03.764906 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-b0f42839-a71c-4547-81fb-f17d59a1aaaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:28:03.837925 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-b0f42839-a71c-4547-81fb-f17d59a1aaaa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.555823 Aug 24 14:28:03.838448 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 14:28:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:28:04.979281 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:28:04.980339 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 24 14:28:04.980756 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:28:05.633385 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-fe66e0ac-293c-4c9c-97d0-fafe207d7eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:28:05.716186 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-fe66e0ac-293c-4c9c-97d0-fafe207d7eb4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.590099 Aug 24 14:28:05.716770 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 14:28:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:28:06.848631 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:28:06.850444 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002596 Aug 24 14:28:06.851221 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:28:07.590957 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-6ed320de-17d7-4edf-be3f-a8f765676e0e admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:28:07.613573 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-6ed320de-17d7-4edf-be3f-a8f765676e0e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.549635 Aug 24 14:28:07.614269 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 24 14:28:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:29:08.366811 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:08.367832 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-f2bd1b21-f37d-49eb-bbc9-f12ee5b12fd1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 24 14:29:08.368237 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 14:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:29:08.377287 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:08.884457 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-2f9a10d8-0f48-43a7-907e-7e5260470f48 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:08.908843 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-2f9a10d8-0f48-43a7-907e-7e5260470f48 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.532966 Aug 24 14:29:08.909502 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 14:29:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:29:08.934799 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG dbcounter [-] [106184] Writing DB stats nova_api:SELECT=14 {{(pid=106184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:29:08.938097 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-2e13ab46-0587-46fa-9848-b3d346af33af admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:08.946861 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-2e13ab46-0587-46fa-9848-b3d346af33af admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015796 Aug 24 14:29:08.947443 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 24 14:29:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:29:08.962961 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-69ff6fd9-ea89-4d27-838a-c7bf00de0074 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:08.972485 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-69ff6fd9-ea89-4d27-838a-c7bf00de0074 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013729 Aug 24 14:29:08.973073 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 24 14:29:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:29:08.987307 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:08.996347 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013841 Aug 24 14:29:08.997056 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 24 14:29:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:29:09.015040 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-6240bb35-e51f-4277-9b70-43da5b88b192 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:09.031995 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-6240bb35-e51f-4277-9b70-43da5b88b192 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023196 Aug 24 14:29:09.033110 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 24 14:29:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:32:34.441357 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:34.451946 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 24 14:32:34.451946 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:32:34.587503 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=6 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:34.779408 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:34.782552 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:32:34.782552 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:32:34.784374 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:34.784920 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:34.785488 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:34.786506 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:34.787156 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:34.787765 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:34.832101 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-756b34b5-c720-4f99-8a7c-ca2d754977c7 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.246729 Aug 24 14:32:34.833240 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:32:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:32:35.782920 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:35.784036 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 24 14:32:35.784458 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:32:36.040233 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:36.044679 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:32:36.044679 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:32:36.046524 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:36.047359 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:36.048106 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:36.049378 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:36.050225 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:36.050967 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:36.090062 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-c8d09328-e5ea-4a3d-b5d7-409d426290a5 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.140440 Aug 24 14:32:36.091125 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:32:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:32:47.997435 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:47.998560 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Aug 24 14:32:47.999259 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:32:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:32:48.149057 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_cell0:SELECT=4 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:48.150331 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_cell1:SELECT=4 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:48.151154 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG dbcounter [-] [106185] Writing DB stats nova_api:SELECT=8 {{(pid=106185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:48.216099 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:48.218892 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:32:48.218892 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:32:48.220151 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:48.220610 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:48.221050 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:48.221792 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:48.222290 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:48.222728 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:48.251681 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-8abdf691-a09f-4818-b190-18ce9fe49ef7 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.107384 Aug 24 14:32:48.252453 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:32:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:32:49.402645 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: DEBUG nova.api.openstack.wsgi [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] Calling method '>' {{(pid=106184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:49.404692 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: INFO nova.api.openstack.requestlog [None req-cded72cd-c454-4a11-8b97-d9f36146f799 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002595 Aug 24 14:32:49.405378 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: [pid: 106184|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 14:32:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:32:49.623635 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG nova.api.openstack.wsgi [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Calling method '>' {{(pid=106185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:49.628134 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:32:49.628134 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: warnings.warn(msg) Aug 24 14:32:49.630336 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:49.631217 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:49.631989 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:49.633788 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:32:49.634684 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:32:49.635460 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: DEBUG oslo_concurrency.lockutils [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:32:49.667340 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: INFO nova.api.openstack.requestlog [None req-c346238e-9cbb-461f-9130-d8470eccf2bc admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.112859 Aug 24 14:32:49.667925 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: [pid: 106185|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 14:32:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:33:47.887044 dv-cinder-756709-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 14:33:47.887986 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: Wed Aug 24 14:33:47 2022 - graceful shutdown triggered... Aug 24 14:33:47.888678 dv-cinder-756709-6-iscsi devstack@n-api.service[106184]: Gracefully killing worker 1 (pid: 106184)... Aug 24 14:33:47.889424 dv-cinder-756709-6-iscsi devstack@n-api.service[106185]: Gracefully killing worker 2 (pid: 106185)... Aug 24 14:33:48.888735 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: worker 1 buried after 1 seconds Aug 24 14:33:48.889327 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: worker 2 buried after 1 seconds Aug 24 14:33:48.889327 dv-cinder-756709-6-iscsi devstack@n-api.service[106175]: goodbye to uWSGI. Aug 24 14:33:48.890324 dv-cinder-756709-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 14:33:48.890885 dv-cinder-756709-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 14:33:48.893860 dv-cinder-756709-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:33:48.903421 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:33:48 2022] *** Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: nodename: dv-cinder-756709-6-iscsi Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: machine: x86_64 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: clock source: unix Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: pcre jit disabled Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: detected number of CPU cores: 4 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: current working directory: / Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: your processes number limit is 47680 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: your memory page size is 4096 bytes Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: detected max file descriptor number: 2048 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: lock engine: pthread robust mutexes Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: thunder lock: enabled Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:33:48.909406 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:33:48.949718 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: Python main interpreter initialized at 0x55a4bb5869c0 Aug 24 14:33:48.949718 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: python threads support enabled Aug 24 14:33:48.949718 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: your server socket listen backlog is limited to 100 connections Aug 24 14:33:48.949718 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:33:48.950217 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:33:48.950301 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: *** Operational MODE: preforking *** Aug 24 14:33:48.950542 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:33:48.950542 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: spawned uWSGI master process (pid: 127900) Aug 24 14:33:48.950772 dv-cinder-756709-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:33:48.952020 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: spawned uWSGI worker 1 (pid: 127922, cores: 1) Aug 24 14:33:48.952020 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: spawned uWSGI worker 2 (pid: 127923, cores: 1) Aug 24 14:33:48.952020 dv-cinder-756709-6-iscsi devstack@n-api.service[127900]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:33:49.655312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:33:49.670107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:33:50.888800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:33:50.888800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: from cryptography.utils import int_from_bytes Aug 24 14:33:50.889870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:33:50.889870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: from cryptography.utils import int_from_bytes Aug 24 14:33:50.933839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:33:50.933839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: from cryptography.utils import int_from_bytes Aug 24 14:33:50.934838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:33:50.934838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: from cryptography.utils import int_from_bytes Aug 24 14:33:53.536279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:33:53.537601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:33:53.539472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:33:53.540164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:33:53.540600 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:33:53.541226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.541797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.542458 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.542948 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.543779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.544325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.544909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.545475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.546080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.546569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.547115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.547585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:33:53.548356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-6-iscsi {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.548514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:33:53.548673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.548860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:33:53.548860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:33:53.549165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.549315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:33:53.549315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.549604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.549750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.550246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.550511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.550764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.551023 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.551276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.551276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.551757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.552008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.552257 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.552532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.552532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.552532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.553233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.553482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.553781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-6-iscsi {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.553781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.553781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.555107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.555107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.555107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.555794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.555794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.557333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.557333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.557333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.557333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.558947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.559260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.559412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.559557 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.560354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-6-iscsi {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.560354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.560846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.561091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.561254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.561254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.561543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.562031 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.562292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.562520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.562520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.562982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.563216 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.563495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.563495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.563982 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.564245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.564245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.564695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.564882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.564882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.565305 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.565469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.565469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.565888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.566206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.566206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.567251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.567531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.567531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.567873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-6-iscsi {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.568976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.569727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.570949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.571541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.571777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.571777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.571777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.571777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.572987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.573265 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.573452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.573452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.573852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.574052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.574052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.574361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.574744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.574744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.575403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.575586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.575586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.575902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.580765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.580765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.581271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.581518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.581762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.582040 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.582040 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.582491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.582736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.582736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.583177 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.583417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.583417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.583880 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.584090 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.584090 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.584538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.584756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.584756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.585897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.586149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.586149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.586620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.587007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.587256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.587490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.587490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.587989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.588227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.588227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.588668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.588899 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.588899 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.589368 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.591060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.591060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.591548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.591787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.591787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.592241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.592482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.592725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.593037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.593037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.593624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.593891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.593891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.594567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.594814 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.594814 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.595278 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.595537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.595537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.596405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.597651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.597883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.597883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.598366 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.598606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.598606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.599114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.599351 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.599351 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.599982 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.601945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.601945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.602706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.602983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.602983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.603420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.603659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.603659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.604939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.605968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.607018 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.607267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.607659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.607918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.607918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.608399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.608657 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.608657 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.609108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.609352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.609352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.609768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.611491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.611491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.612089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.612323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.612700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.612943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.612943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.613404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.613656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.613656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.614243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.614717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.614717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.615174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.615414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.615414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.615856 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.616080 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.616808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.617334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.617334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.617637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.617863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.617863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.618348 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.618583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.618583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.619069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.619364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.619873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.620141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.620141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.621433 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.621696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.621696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.621696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.621696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.623201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.623649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.623649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.624136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.624372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.624627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.625001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.625001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.625509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.625766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.625766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.626241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.626491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.626491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.626962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.628442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.628442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.628901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.629144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.629378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.629610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.629610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.630136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.630393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.630393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.631445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.631445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.632138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.632138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.632972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.633401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.633889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.634180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.634180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.634669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.634954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.634954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.635782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.636014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.636014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.636481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.636741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.637006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.637907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.637907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.638662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.638907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.638907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.639353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.639620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.639620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.640098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.640367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.640367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.641175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.641661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.642094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.642347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.642347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.643162 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.643420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.643420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.644008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.644252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.644252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.644653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.644945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.644945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.645246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.645538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.645538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.645863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.646317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.646317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.646317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.646317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.646997 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.647143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.647143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.648110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.649334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.649334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.649776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.650168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.650168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.650569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.650727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.650727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.651086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.651578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.651853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.652038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.652038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.652451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.652597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.652597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.652597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.653418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.653854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.653854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.654548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.654780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.654780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.655253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.655509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.655884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.656402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.656402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.656870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.657106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.657106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.657569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.657813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.657813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.658319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.658563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.658839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.659385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.659385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.659847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.660104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.660104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.660555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.660789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.661026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.661428 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.661428 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.662647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.662904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.662904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.663577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.665239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.665239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.665719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.666158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.666158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.666668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.666908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.667144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.667392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.667392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.668007 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:33:53.668253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.668253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.668715 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.668950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.668950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.669618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.669894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.669894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.670650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.672309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.672582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.672582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.673207 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.673457 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.673457 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.674127 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.674585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.674585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.675315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.675564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.675564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.676024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.676454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.676716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.676950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.676950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.677407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.677638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.677638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.677638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.678363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.678596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.678596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.679060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.679419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.679419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.679419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.680841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.681851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.683401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.683646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.683646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.683646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.684502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.685345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.685345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.685345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.686272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.686680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.686680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.686680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.687390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.687608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.687608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.687608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.688295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.688511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.688511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.688511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.689271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.689543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.689543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.689543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.690470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.690904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.690904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.691389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.691645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.691645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.692437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.695053 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.695516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.695516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.696157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.696412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.696412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.697079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.697293 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.697481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.697754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.697754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.698247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.698531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.698531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.699108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.699370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.699370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.699370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.700118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.700493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.700765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.701765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.702397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.702634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.702634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.702634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.703888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.704267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.704267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.704892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.705144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.705144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.705865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.706189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.706668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.706866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.706866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.707340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.707648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.707648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.708169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.708423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.708423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.708930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.709838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.711414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.711673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.711673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.711673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.712432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.712693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.712693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.712693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.714408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.715873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.716316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.716316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.716316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.716316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.717554 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.717757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.717757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.717757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.718540 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.718794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.718794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.718794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.719389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.719670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.719670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.719670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.719670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.720361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.720530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.720530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.720530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.721041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.721405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.721405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.721405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.721954 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.722778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.723143 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.723877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.723877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.724413 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.724688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.724688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.725064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.725423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.725423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.725963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.726257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.726257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.726788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.726989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.726989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.727572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.728139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.728139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.728643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.728895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.728895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.729396 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.729688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.729940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.730245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.730245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.730245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.730245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.731834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.732966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.733237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.733237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.733237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.734623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.734910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.734910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.735438 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.735852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.735852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.735852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.736960 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.737158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.737158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.737985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.738399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.738399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.738399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.739285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.739546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.739546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.739546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.740280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.740540 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.740540 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.741035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.741373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.741373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.741373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.742337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.742596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.742596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.743079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.743335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.743335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.743335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.744506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.744941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.744941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.745482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.745704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.745704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.745704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.746622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.746901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.746901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.746901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.747833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.748262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.748534 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.748789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.748789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.748789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.749577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.749822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.749822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.749822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.751382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.751659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.751659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.752335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.752598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.752598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.752598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.753353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.753611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.753611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.753611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.754824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755222 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755222 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.755944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.756831 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.757819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.757819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.758558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.759023 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.759023 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.759436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.759705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.759705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.760210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.760476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.760727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.760986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.760986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.761438 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.761690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.761690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.762291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.762699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.762964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.763211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.763211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.764215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.764490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.764490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.765560 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.765827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.766173 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.766605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.766605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.766927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.767122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.767122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.767624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.768079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.768345 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.768596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.768596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.769203 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.769419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.769598 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.769785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.769785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.770378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.770644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.770644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.771145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.771393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.771393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.771859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.772123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.772307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.772472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.772472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.773638 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.773881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.773881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.774329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.774535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.774770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.775330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.775330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.775910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.776174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.776426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.776924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.776924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.777424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.777779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.777779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.778897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.780209 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.780395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.780395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.780993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.781922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.782872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.783930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784092 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784092 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.784868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.785037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.785037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.785037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.785840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786607 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786784 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.786784 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.787244 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.787412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.787574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.787745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.787745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.788057 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.788238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.788238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789818 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789977 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.789977 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.790927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791835 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.791835 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792129 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.792902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.793116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.793116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.793434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.793619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.793619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.794895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.795198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.795790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.795790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796131 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796857 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.796857 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.797281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.797438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.797438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.797750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.797901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798427 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.798924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.799729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.800943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.801248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.801399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.801548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.801699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.801699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.802955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803257 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.803961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.804942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.805131 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.805131 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.805457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.806821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.807145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.807429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.807429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.807429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.807429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.808950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.809116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.809267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.809438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.809438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.809895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.810254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.810254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.810553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.810703 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.810863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.811113 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.811113 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.811617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.811804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.811804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.812766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.812937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.813898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.814083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.814083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.814393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.814545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.814545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.815845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.816627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.816908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.816908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817240 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817825 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.817979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.818321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.818490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.818490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.818788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.818941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.819099 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.819265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.819265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.819702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.820135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.820135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.820673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.820906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.820906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.821236 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.821444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.821444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.821750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.821912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.822167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.822368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.822368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.822368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.822858 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.823037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.823037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.823529 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.823717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.823717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824483 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824642 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824642 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.824940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.825249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.825249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.825564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.825736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.825736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.826078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.826382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.826382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.827061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.827250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.827424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.827578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.827578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828664 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.828982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.829654 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.829821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.829821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.830298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.830488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.830488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.830935 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831722 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.831886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832955 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.832955 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.833893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834433 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834433 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.834890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.835687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.835892 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.836065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.836239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.836239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.837077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.837358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.837358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.837744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.838939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.839876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.840171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.840480 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.840480 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.840480 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.841912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.842876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843683 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.843837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.844751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.845898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.846234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.846387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.846559 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.846733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.846733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.847381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.847649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.847649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.847973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848576 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.848740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.849829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.850230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.850230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.853831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.854155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.854605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.854766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.854941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.854941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.855255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.855417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.855417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.855856 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856654 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.856813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.858272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.858561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.858561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.858884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859360 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859828 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.859979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.860410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.860579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.860909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.861545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862009 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.862965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.863352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.863352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.863677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.863837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.863989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.864883 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.865819 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.866144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.866144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.866144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.867190 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.867591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.867591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.868388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.869691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.871194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.872331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.873660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.875121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.876718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.878635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.880055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.881370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.883052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.884647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.885798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.886941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.886941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO dbcounter [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Registered counter for database nova_api Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.887870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.888936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.889921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.890759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.891412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.891412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.891755 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.892321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.892929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.893459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.893961 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.894582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.894991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.895334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.895547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_db.sqlalchemy.engines [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:53.895751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.896130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.896592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.896913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.897245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.897564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.898084 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.898614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.899005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.899329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.899655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.899972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.900311 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.900635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.900998 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.901288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.901606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.901923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.902409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.902772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.903175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.903523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.903897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.904234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.904771 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.904922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.905039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writer thread running {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:53.905197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.905523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.905847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.906288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.906524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.906841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.907163 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.907485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.907914 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.908565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.908861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.909147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.909470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.909793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.910156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.910626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.910952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.911275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.911594 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.911914 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.912404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.912586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.912908 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.913795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.914188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.914829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.915731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.915731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.916238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.916238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.916776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.917213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.917489 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.917758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.918071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.918335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.918630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.918952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.919275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.919594 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.919918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.920233 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.920656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.921010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.921343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.921665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.922078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.922337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.922910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.923379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.923586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.923919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.924249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.924576 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.924946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.925218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.925531 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.925865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.926225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.926548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.926852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.927234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.927494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.927804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.928130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.928443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.929243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.933871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.938905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.939645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.940673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.940673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.940673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.941050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.941195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.941618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.941789 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.942414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.942584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.942913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.943232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.943549 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.943907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.944232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.945442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.946185 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.946556 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.946920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.947268 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.947582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.947897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.948216 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.948551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.948878 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.949283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.949569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.949825 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.950199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.950496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.950818 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.951136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.951460 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.951874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.952088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.952412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.952731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.953047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.953366 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.953762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.954198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.954643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.954838 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.955160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.955478 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.955796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.956146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.956457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.956882 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.957223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.957545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.957855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.958369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.958689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.959012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.959344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.959656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.959982 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.961092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.961644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.962289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.962487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.962682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.963034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.963370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.963702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.964081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.964400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.964713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.965025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.965356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.965665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.966095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.966306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.966614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.967086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.967405 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.967715 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.968021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.968334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.968640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.968944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.969240 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.969545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.969852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.970186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.970504 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.970809 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.971239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.971553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.971866 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.972200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.972548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.972770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.context [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b63dd42d-f9d6-49b8-bedc-eb04d541d366(cell1) {{(pid=127922) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:33:53.972989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.973189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.973521 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.973841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.974241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.974572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.975030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.975368 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.976108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.976108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.976606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.976839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:33:53.977141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.977358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:33:53.977525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.977755 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.978089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.978450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.978768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.978929 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:33:53.979089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.979429 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.979668 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:33:53.979844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.980061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.980313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:33:53.980465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.980736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.981124 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.981289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.981636 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.981952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.982163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:33:53.982320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.982636 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.983006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.983254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.983582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.983895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.984211 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.984402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO dbcounter [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Registered counter for database nova_cell0 Aug 24 14:33:53.984562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.984838 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.985173 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.985499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.985816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.986174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.986765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.987132 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.987451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.987804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.988138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.988458 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.988766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO dbcounter [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Registered counter for database nova_cell1 Aug 24 14:33:53.988920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.989141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:33:53.989291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:33:53.999910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_db.sqlalchemy.engines [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.000487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_db.sqlalchemy.engines [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.005391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writer thread running {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.012604 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writer thread running {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.059990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO dbcounter [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Registered counter for database nova_api Aug 24 14:33:54.086182 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_db.sqlalchemy.engines [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.094415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writer thread running {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.157489 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.context [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b63dd42d-f9d6-49b8-bedc-eb04d541d366(cell1) {{(pid=127923) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:33:54.161810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:33:54.162341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:33:54.164717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:33:54.166095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:33:54.166572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:33:54.167208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO dbcounter [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Registered counter for database nova_cell0 Aug 24 14:33:54.168697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:33:54.173491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO dbcounter [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Registered counter for database nova_cell0 Aug 24 14:33:54.174640 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_db.sqlalchemy.engines [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.175630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO dbcounter [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Registered counter for database nova_cell1 Aug 24 14:33:54.180474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writer thread running {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.184125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_db.sqlalchemy.engines [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.187631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_db.sqlalchemy.engines [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.190337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writer thread running {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.358271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writer thread running {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.372877 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO dbcounter [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Registered counter for database nova_cell0 Aug 24 14:33:54.386044 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_db.sqlalchemy.engines [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:33:54.392513 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writer thread running {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:33:54.541368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: WARNING keystonemiddleware.auth_token [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:33:54.548874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: WARNING keystonemiddleware.auth_token [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:33:54.740315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: WARNING keystonemiddleware.auth_token [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:33:54.749841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: WARNING keystonemiddleware.auth_token [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:33:54.913270 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: WARNING keystonemiddleware.auth_token [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:33:54.919975 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: WARNING keystonemiddleware.auth_token [None req-f9509532-c105-40e1-815b-8d52626a0dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:33:54.925873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4bb5869c0 pid: 127922 (default app) Aug 24 14:33:55.135027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: WARNING keystonemiddleware.auth_token [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:33:55.141413 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: WARNING keystonemiddleware.auth_token [None req-34fc575a-b6a8-45bf-9775-d84dda038983 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:33:55.146963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a4bb5869c0 pid: 127923 (default app) Aug 24 14:34:38.364661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:38.368400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:38.371218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:38.373053 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:39.438847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-02a62fc2-b8be-48a9-b686-9ebdbee00fbd tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Action: 'create', calling method: .version_select at 0x7f8a8e07eb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-899468251", "metadata": {"Type": "work"}}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:42.633204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-02a62fc2-b8be-48a9-b686-9ebdbee00fbd tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.286902 Aug 24 14:34:42.634500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 14:34:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4290 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:34:42.986178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ac0d5480-81b4-4913-bf64-363944e6b58b tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8e1ad430>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:43.016704 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:43.017712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:43.018709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:43.019838 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:43.800605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ac0d5480-81b4-4913-bf64-363944e6b58b tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 200 len: 352 microversion: 2.1 time: 1.136845 Aug 24 14:34:43.802259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:42 2022] GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 352 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:44.827852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ac924d84-9d56-4444-a79c-572a1dc0eb97 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8e07ee50>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:45.170695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ac924d84-9d56-4444-a79c-572a1dc0eb97 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 200 len: 353 microversion: 2.1 time: 0.352085 Aug 24 14:34:45.171759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:44 2022] GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 353 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:45.196320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3220e327-6eaf-4544-af54-f8d54059c4ab tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8df878b0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:45.357725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3220e327-6eaf-4544-af54-f8d54059c4ab tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 200 len: 353 microversion: 2.1 time: 0.175293 Aug 24 14:34:45.359042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:45 2022] GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:45.384329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-49037192-e95b-45e5-99bf-2daf99bdea5b tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8df579d0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:45.949754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-49037192-e95b-45e5-99bf-2daf99bdea5b tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 202 len: 0 microversion: 2.1 time: 0.574149 Aug 24 14:34:45.950879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:34:45 2022] DELETE /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:34:45.966230 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d68a9482-8bcc-4cf5-9a2a-1ebc30e8be6f tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8df87e50>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:46.164528 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d68a9482-8bcc-4cf5-9a2a-1ebc30e8be6f tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 200 len: 352 microversion: 2.1 time: 0.207753 Aug 24 14:34:46.165134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:45 2022] GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:34:47.193838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1e079266-3f97-44b3-888b-6c99c04bf997 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Calling method '.version_select at 0x7f8a8df57ee0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:47.297313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-1e079266-3f97-44b3-888b-6c99c04bf997 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] HTTP exception thrown: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1e079266-3f97-44b3-888b-6c99c04bf997 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Request method failure captured: Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 HTTP/1.1 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjb-OGDLgsQxhlgyPsKDSny510dHcJPUiSnfIE2q7Z_WVTwgLX8_tVRj1tsBE726gi7W3wXcdjTf8qlfmi5mSuVi8UlAhHgG0VY05Rv4s-PVrNjqCUbYtEDq4p9OpmOKToXKWuYrHnNStyAJ3_UU3JMtaLeAK_oYd8ebqK6EMEbF_6M Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 85352dbb41424d14bab00dfc491b93c5 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesGetTestJSON-474301396 Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:34:47.303562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85352dbb41424d14bab00dfc491b93c5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85352dbb41424d14bab00dfc491b93c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85352dbb41424d14bab00dfc491b93c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85352dbb41424d14bab00dfc491b93c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesGetTestJSON-474301396 Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 85352dbb41424d14bab00dfc491b93c5 Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesGetTestJSON-474301396 Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesGetTestJSON-474301396-project Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 32f6802c125e417791721c23e2e3c900 Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesGetTestJSON-474301396-project Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '1de1ba5a-c9c3-410f-b354-3c82b1cad055'} Aug 24 14:34:47.308581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. (HTTP 404) (Request-ID: req-344dccbb-98e7-48f5-b444-0647837432b1) Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:47.310365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:34:47.311730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:34:47.315658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. Aug 24 14:34:47.320259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:47.327033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1e079266-3f97-44b3-888b-6c99c04bf997 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] Returning 404 to user: Volume 1de1ba5a-c9c3-410f-b354-3c82b1cad055 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:47.328496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1e079266-3f97-44b3-888b-6c99c04bf997 tempest-VolumesGetTestJSON-474301396 tempest-VolumesGetTestJSON-474301396-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055" status: 404 len: 109 microversion: 2.1 time: 0.146400 Aug 24 14:34:47.328689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:47 2022] GET /compute/v2.1/os-volumes/1de1ba5a-c9c3-410f-b354-3c82b1cad055 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:34:55.672082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-891e8cfc-37d2-41ac-a2be-d3ee7746b5b4 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Action: 'create', calling method: .version_select at 0x7f8a8df50430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-429993986", "metadata": {"Type": "work"}}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-891e8cfc-37d2-41ac-a2be-d3ee7746b5b4 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 121 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:34:55.697487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-429993986", "metadata": {"Type": "work"}}} Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: Aug 24 14:34:55.698727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-429993986', 'metadata': {'Type': 'work'}}}} Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:55.699378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:34:55.700398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:34:55.701315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:34:55.701315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.703340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-891e8cfc-37d2-41ac-a2be-d3ee7746b5b4 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:55.705670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-891e8cfc-37d2-41ac-a2be-d3ee7746b5b4 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.467729 Aug 24 14:34:55.710833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 4/8] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 14:34:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:34:55.722402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9ad72a69-9c92-4ac9-b0a6-ee439a024763 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Action: 'create', calling method: .version_select at 0x7f8a8df6ddc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229153194", "metadata": {"Type": "work"}}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9ad72a69-9c92-4ac9-b0a6-ee439a024763 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 120 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:34:55.737198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229153194", "metadata": {"Type": "work"}}} Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:34:55.738440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1229153194', 'metadata': {'Type': 'work'}}}} Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi '0' Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:55.739060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:34:55.740047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:34:55.740917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:34:55.740917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.743700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9ad72a69-9c92-4ac9-b0a6-ee439a024763 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:55.749794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9ad72a69-9c92-4ac9-b0a6-ee439a024763 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032104 Aug 24 14:34:55.752447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 5/9] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 14:34:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:34:55.773896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db6d60b-f1a9-4bca-a41b-b96c08352609 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Action: 'create', calling method: .version_select at 0x7f8a8df503a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-295465660", "metadata": {"Type": "work"}}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db6d60b-f1a9-4bca-a41b-b96c08352609 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 118 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:34:55.783069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-295465660", "metadata": {"Type": "work"}}} Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: Aug 24 14:34:55.785304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-295465660', 'metadata': {'Type': 'work'}}}} Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi '' Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:55.786718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:34:55.789089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:34:55.791197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:34:55.791197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.791197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db6d60b-f1a9-4bca-a41b-b96c08352609 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:55.793823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9db6d60b-f1a9-4bca-a41b-b96c08352609 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024451 Aug 24 14:34:55.800617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 5/10] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 14:34:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:34:55.809644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2104e493-4185-40c8-ab37-17b17c55d10d tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Calling method '.version_select at 0x7f8a8def75e0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:55.886095 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-2104e493-4185-40c8-ab37-17b17c55d10d tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] HTTP exception thrown: Volume tempest-invalid-175264752 could not be found. Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2104e493-4185-40c8-ab37-17b17c55d10d tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-175264752 HTTP/1.1 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:34:55.888329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Volume tempest-invalid-175264752 could not be found. Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'tempest-invalid-175264752'} Aug 24 14:34:55.899737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-175264752 could not be found. (HTTP 404) (Request-ID: req-3702a188-6b71-4d8d-bb03-0a399049263c) Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.901732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:34:55.904209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-175264752 could not be found. Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:55.906843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-175264752 could not be found. Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-175264752 could not be found. Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2104e493-4185-40c8-ab37-17b17c55d10d tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 404 to user: Volume tempest-invalid-175264752 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2104e493-4185-40c8-ab37-17b17c55d10d tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-175264752" status: 404 len: 98 microversion: 2.1 time: 0.087623 Aug 24 14:34:55.909117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 24 14:34:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-175264752 => generated 98 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 14:34:55.915899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-416b3219-e87d-4310-ab1e-cfb3315b13c4 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015136 Aug 24 14:34:55.916679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 14:34:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:34:55.928186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dfbae8b1-f114-4d60-b1c5-7b3198b61fa1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003988 Aug 24 14:34:55.935850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 14:34:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:34:55.947727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7b39da54-5a95-433c-8cd6-e445e4f941c1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Calling method '.version_select at 0x7f8a8df50c10>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:56.032511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-7b39da54-5a95-433c-8cd6-e445e4f941c1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] HTTP exception thrown: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7b39da54-5a95-433c-8cd6-e445e4f941c1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/os-volumes/69de984d-91da-478d-8579-8bbf55d1e3c7 HTTP/1.1 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:34:56.037865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '69de984d-91da-478d-8579-8bbf55d1e3c7'} Aug 24 14:34:56.040213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. (HTTP 404) (Request-ID: req-50f6f831-b904-4043-9de7-1d86cc17ac62) Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.041764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:34:56.043889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:34:56.060747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7b39da54-5a95-433c-8cd6-e445e4f941c1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 404 to user: Volume 69de984d-91da-478d-8579-8bbf55d1e3c7 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7b39da54-5a95-433c-8cd6-e445e4f941c1 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/69de984d-91da-478d-8579-8bbf55d1e3c7" status: 404 len: 109 microversion: 2.1 time: 0.107123 Aug 24 14:34:56.063574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:34:55 2022] DELETE /compute/v2.1/os-volumes/69de984d-91da-478d-8579-8bbf55d1e3c7 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:34:56.067195 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e17bf395-2d4c-4aa4-8458-84bd75e73c65 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Calling method '.version_select at 0x7f8a8df6d940>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:34:56.153617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-e17bf395-2d4c-4aa4-8458-84bd75e73c65 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] HTTP exception thrown: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e17bf395-2d4c-4aa4-8458-84bd75e73c65 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Request method failure captured: Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/os-volumes/277e1935-b54c-458e-a7b4-1600f7a801bc HTTP/1.1 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcPRgu0ocm7vpB8EoJvNYE27adPmfE9QE5P2Y7NycP-OLgRE2b5ZRNoSc_vKKFbkflCssRDFrqCp_W_PEL38JciGP7WI1y66PAVzahFJA4AjGQE0qBOeY8XZiTHMkWaL0ysQW8u1IJAHxLRMOZPhgp15HQ89NJcTj05uzsqWWv_4hM Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:34:56.157212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f68349a353f143a99a250b6489268598", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f68349a353f143a99a250b6489268598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f68349a353f143a99a250b6489268598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: f68349a353f143a99a250b6489268598 Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesNegativeTest-1994830928 Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: b12a81ddb47146568ad5cf334a6d01eb Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesNegativeTest-1994830928-project Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '277e1935-b54c-458e-a7b4-1600f7a801bc'} Aug 24 14:34:56.159251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. (HTTP 404) (Request-ID: req-d387c346-5c17-47a1-8154-40b43115e6bb) Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.163225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:34:56.179851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:34:56.181469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e17bf395-2d4c-4aa4-8458-84bd75e73c65 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] Returning 404 to user: Volume 277e1935-b54c-458e-a7b4-1600f7a801bc could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e17bf395-2d4c-4aa4-8458-84bd75e73c65 tempest-VolumesNegativeTest-1994830928 tempest-VolumesNegativeTest-1994830928-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/277e1935-b54c-458e-a7b4-1600f7a801bc" status: 404 len: 109 microversion: 2.1 time: 0.098272 Aug 24 14:34:56.190561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:34:56 2022] GET /compute/v2.1/os-volumes/277e1935-b54c-458e-a7b4-1600f7a801bc => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:34:58.051204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1471638215", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:58.338723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] validate_networks() for [('d025b1af-d5b6-4d76-9e5f-f5e52ae15180', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:34:59.687767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9facb941-1d3c-4dea-b410-15fc6306cef1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: .version_select at 0x7f8a8df6d9d0>, body: {"keypair": {"name": "tempest-keypair-1688464293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWSwN9jrixoRk/hNowga9/S4pW9sslSAz6EUisltX2vrxlUIcYDdAY9Pym5Ccf9lmbAP6s8T1NfXiT15SOeJPiFK4lhbyNpd1O4rHLMgJebguMlrWGjkUOgFAUoLegM3A=="}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:34:59.898418 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-9facb941-1d3c-4dea-b410-15fc6306cef1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:34:59.972578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-9facb941-1d3c-4dea-b410-15fc6306cef1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:00.258475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9facb941-1d3c-4dea-b410-15fc6306cef1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.174551 Aug 24 14:35:00.258475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 9/16] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:34:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:35:01.775954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-389e9d92-4e6f-4739-bc2a-dc89c7154315 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: .version_select at 0x7f8a8de5c160>, body: {"keypair": {"name": "tempest-keypair-1684012220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhdKnlDMCVz5k7tlHAoQCrmsBxg3LpJ543DZUMFd2bLrJ88eBZZU55a6EJmD3gdkdVXDGdLLtYztYgp7OROTxWJMGVdirMRbOjxTjOyzuTzYYEiSa5ZYNM3+7eNwt9ybw=="}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:01.838577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-389e9d92-4e6f-4739-bc2a-dc89c7154315 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:01.840689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-389e9d92-4e6f-4739-bc2a-dc89c7154315 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for user 7b946ecd87434ad6a00890887d234281 and project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:01.981401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-389e9d92-4e6f-4739-bc2a-dc89c7154315 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.044169 Aug 24 14:35:01.982450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 10/17] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:35:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:02.660072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:02.660901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:02.661894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:02.662716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:02.664572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:02.725330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:02.729853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:02.730920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:02.733857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:02.734695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:02.735352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:02.909586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:02.946896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for user 3570472f8c2b42b480ec1d1220414bec and project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:03.016354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:03.032847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:03.690301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5a3d892d-ab07-4634-82fa-b91649713c01 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.484617 Aug 24 14:35:03.698364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 8/18] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:34:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 6494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:35:03.728353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4d8a66f1-fac6-4b7a-b06f-8dbb883a3b74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:03.733062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4d8a66f1-fac6-4b7a-b06f-8dbb883a3b74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:04.413381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4d8a66f1-fac6-4b7a-b06f-8dbb883a3b74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:04.466530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4d8a66f1-fac6-4b7a-b06f-8dbb883a3b74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1222 microversion: 2.1 time: 0.750871 Aug 24 14:35:04.484794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:03 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1222 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:04.729356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7ac5b511-a7e5-4a2a-9588-d0612a21605b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: .version_select at 0x7f8a8ddf2700>, body: {"keypair": {"name": "tempest-keypair-597025216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmVTkFnbbJyw5l0qE6pVMHOdILk8/qu+4RHHwAU4yVwuxUocRpMEbB3+u74XhCgCRYft5l3htnwqI6PAOivrC75jRuL4339rNpFJV6GzI8sSWHyLWmX/i+GgirGD3W0kQ=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:04.916275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-7ac5b511-a7e5-4a2a-9588-d0612a21605b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for project 5981da6161ac4717a5b433c31188da53. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:04.947314 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-7ac5b511-a7e5-4a2a-9588-d0612a21605b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for user c888090dd9f246a79c6be54faf480ed9 and project 5981da6161ac4717a5b433c31188da53. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:05.125282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-24876547", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:05.146763 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7ac5b511-a7e5-4a2a-9588-d0612a21605b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.743161 Aug 24 14:35:05.149624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 9/20] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 14:35:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 749 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:35:05.380253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] validate_networks() for [('d025b1af-d5b6-4d76-9e5f-f5e52ae15180', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:35:09.130969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:09.130969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:09.130969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:09.130969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:09.130969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:09.210123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:09.210123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:09.210123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:09.210123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:09.216025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:09.216025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:09.216025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:09.216025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for user 3570472f8c2b42b480ec1d1220414bec and project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:09.217296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:09.217296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:09.218411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1452567181", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "networks": [{"uuid": "60e89dd0-ef7e-4fa8-a831-f57a9d93c830"}]}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:09.297280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-de8b003b-b345-4087-b85a-6ed43949f036 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.171683 Aug 24 14:35:09.297280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 12/21] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:35:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:35:09.306868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-583835a3-d529-4a3a-98f2-52451b62b547 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:09.307503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-583835a3-d529-4a3a-98f2-52451b62b547 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:09.337979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] validate_networks() for [('60e89dd0-ef7e-4fa8-a831-f57a9d93c830', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:35:09.630705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-583835a3-d529-4a3a-98f2-52451b62b547 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:09.648229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-583835a3-d529-4a3a-98f2-52451b62b547 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1220 microversion: 2.1 time: 0.346568 Aug 24 14:35:09.667319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 13/22] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:09 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1220 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:09.689359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-538524293", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c1b2e1f-70b2-4451-9050-eb07b892f67d"}], "security_groups": [{"name": "tempest-securitygroup--1776551669"}], "key_name": "tempest-keypair-1688464293", "user_data": "}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:10.036233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] validate_networks() for [('9c1b2e1f-70b2-4451-9050-eb07b892f67d', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:35:11.218896 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:11.220189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:11.220860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:11.221493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:11.222827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:11.251109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:11.253449 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:11.254481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:11.255274 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:11.255870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:11.268182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:11.269039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:11.272964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:11.274244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:11.278944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:11.290295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:11.302580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:11.306553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:11.308455 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:11.311202 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:11.321226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:11.321976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:11.373328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:11.401120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:11.420859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Getting quotas for project e1041161b38e4ee0b0b4d7d1f6b3994c. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:11.436701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Getting quotas for user e84d3ad291644b84b204b0b3102a095a and project e1041161b38e4ee0b0b4d7d1f6b3994c. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:11.462017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:11.467279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:11.472751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:11.474404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:11.753224 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b34f43f9-61ef-4e1d-830f-23834d014728 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.791000 Aug 24 14:35:11.759900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 10/23] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:35:11.792002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3c53a68c-7e00-43d8-8633-61f47151f8ec tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:11.792002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3c53a68c-7e00-43d8-8633-61f47151f8ec tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:12.032603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cb1d1348-197b-42e1-bd49-636e160bac27 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.344480 Aug 24 14:35:12.051554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 14/24] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:35:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:35:12.098751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-85a4092b-110b-4ecd-b9ab-5ab865faf84b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:12.109058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-85a4092b-110b-4ecd-b9ab-5ab865faf84b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:12.490419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-85a4092b-110b-4ecd-b9ab-5ab865faf84b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:12.536415 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-85a4092b-110b-4ecd-b9ab-5ab865faf84b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1215 microversion: 2.1 time: 0.482512 Aug 24 14:35:12.542519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 15/25] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:12 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1215 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:12.595788 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fd598a3e-1d0a-4693-9de1-e9adf3abe1c1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:12.597396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fd598a3e-1d0a-4693-9de1-e9adf3abe1c1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:12.755192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fd598a3e-1d0a-4693-9de1-e9adf3abe1c1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:12.768473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fd598a3e-1d0a-4693-9de1-e9adf3abe1c1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1241 microversion: 2.1 time: 0.204100 Aug 24 14:35:12.784669 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 16/26] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:12 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:13.081344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3c53a68c-7e00-43d8-8633-61f47151f8ec tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:13.104623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3c53a68c-7e00-43d8-8633-61f47151f8ec tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1220 microversion: 2.1 time: 1.342676 Aug 24 14:35:13.111092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 11/27] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:11 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1220 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:13.581196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b4c5d92c-89d9-4fd1-b1d3-2255871ffdb3 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:13.581820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b4c5d92c-89d9-4fd1-b1d3-2255871ffdb3 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:13.728923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b4c5d92c-89d9-4fd1-b1d3-2255871ffdb3 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:13.738177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b4c5d92c-89d9-4fd1-b1d3-2255871ffdb3 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1215 microversion: 2.1 time: 0.161046 Aug 24 14:35:13.753781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 17/28] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:13 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:13.795510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4e89cb70-a588-428b-b722-d01886551cb1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:13.796194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4e89cb70-a588-428b-b722-d01886551cb1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:14.086310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4e89cb70-a588-428b-b722-d01886551cb1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:14.101477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4e89cb70-a588-428b-b722-d01886551cb1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1241 microversion: 2.1 time: 0.310100 Aug 24 14:35:14.106855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 12/29] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:13 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1241 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:14.120381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-55889392", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f1fda62-4842-49d3-9357-99396d1dc4a1"}], "security_groups": [{"name": "tempest-securitygroup--1171339437"}], "key_name": "tempest-keypair-1684012220", "user_data": "}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:14.133514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:14.134567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:14.150119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:14.153285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:14.155490 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:14.157491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:14.157986 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:14.158450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:14.603447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:14.630374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c31c1a44-5f27-4c97-ae89-c4aaae36baa2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1272 microversion: 2.1 time: 0.501167 Aug 24 14:35:14.634533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 13/30] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:14 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1272 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:14.763050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:14.763681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:14.788922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:14.790113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:14.796778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:14.798589 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:14.805314 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:14.805775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:14.944987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] validate_networks() for [('9f1fda62-4842-49d3-9357-99396d1dc4a1', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:35:15.386055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:15.406618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6dfb9e52-c4c5-4c32-8240-98d8bc7eb8f4 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1219 microversion: 2.1 time: 0.647495 Aug 24 14:35:15.411361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 14/31] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:14 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1219 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:15.426532 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ce4bb549-638b-479f-a97b-29b69ad50771 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:15.430355 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ce4bb549-638b-479f-a97b-29b69ad50771 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:16.476673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ce4bb549-638b-479f-a97b-29b69ad50771 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:16.510115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ce4bb549-638b-479f-a97b-29b69ad50771 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1241 microversion: 2.1 time: 1.098822 Aug 24 14:35:16.511088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 15/32] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:15 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1241 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:16.532436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:16.533355 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:16.542440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.549058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.549058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.549058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.549058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.549474 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.706934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:16.708725 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:16.709688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:16.710442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:16.721530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:16.766072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.773044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.773921 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.783329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.789758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.795500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.804743 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:16.819091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-febf9823-bf62-4767-9e7b-e696dd2588b3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1278 microversion: 2.1 time: 0.292290 Aug 24 14:35:16.822456 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 16/33] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:16 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:16.843994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:16.845025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:16.863165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.866695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.866894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.867685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:16.868180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:16.873479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:16.904440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:16.941596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for user 7b946ecd87434ad6a00890887d234281 and project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:17.051499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:17.066204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:17.162163 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:17.200109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a00ac89e-b3b1-4943-8577-a092593142e6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1267 microversion: 2.1 time: 0.372340 Aug 24 14:35:17.201031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:16 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1267 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:17.327764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-281281329", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21aeb1d4-5bbd-47dc-90e4-adede63fdee0"}], "security_groups": [{"name": "tempest-securitygroup--190749944"}], "key_name": "tempest-keypair-597025216", "user_data": "}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:17.605591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-89d07d6a-f05a-48c3-aef7-ad52ad293d93 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.497440 Aug 24 14:35:17.612944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:35:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:35:17.639158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:17.639158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:17.717393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:17.724232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:17.728762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:17.735166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:17.747075 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:17.747609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:18.159999 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] validate_networks() for [('21aeb1d4-5bbd-47dc-90e4-adede63fdee0', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:35:18.484952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:18.552416 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c71db9cf-9039-46d2-a750-f3736bbc4216 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1293 microversion: 2.1 time: 0.936845 Aug 24 14:35:18.560874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:17 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1293 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:18.568529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-12b461fa-6675-4794-afa0-9026b682c221 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:18.573474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-12b461fa-6675-4794-afa0-9026b682c221 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:18.583442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:18.997392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-12b461fa-6675-4794-afa0-9026b682c221 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:19.015474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-12b461fa-6675-4794-afa0-9026b682c221 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1236 microversion: 2.1 time: 0.453133 Aug 24 14:35:19.045786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 20/37] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:18 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1236 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:19.070892 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:19.085670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:19.157194 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:19.158849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:19.161232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:19.166557 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:19.170167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:19.172585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:19.637705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:19.668276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-abc0f27a-914c-481e-91f3-860d0dfcb365 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1278 microversion: 2.1 time: 0.614388 Aug 24 14:35:19.668276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 21/38] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:19 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1278 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:19.685822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:19.706879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:19.748811 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:19.749709 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:19.760603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:19.760603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:19.760603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:19.762744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.071155 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:20.085443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6372f3b7-5d50-4711-8e3a-4e3d9c20a911 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1273 microversion: 2.1 time: 0.418864 Aug 24 14:35:20.120148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 22/39] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:19 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:20.120148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:20.120148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:20.127191 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.127741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.128247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.129085 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.131138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.132331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.533264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:20.555459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e119db20-54e7-4475-9cc7-cc9463a9ad0e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1299 microversion: 2.1 time: 0.467522 Aug 24 14:35:20.556354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 23/40] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:20 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1299 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:20.561570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:20.562641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:20.580478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.581230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.585372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.586861 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.588274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.588917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.823488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:20.837282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6bea6d26-2cf7-4a15-924f-861ccd8bf4b4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1240 microversion: 2.1 time: 0.279569 Aug 24 14:35:20.838492 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 24/41] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:20 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1240 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:20.848608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:20.867810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:20.876172 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.879997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.879997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:20.879997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:20.879997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:20.880525 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:21.237354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:21.279241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8608de5a-36ab-4add-85b5-bb65449c2203 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1278 microversion: 2.1 time: 0.439283 Aug 24 14:35:21.280224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 25/42] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:20 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1278 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:21.298225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:21.305043 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:21.315570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:21.316300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:21.317079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:21.318373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:21.319742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:21.320634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:21.341462 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.575875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:21.603105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fc53e6c3-7951-4bd0-b467-73aa334c8ae2 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1273 microversion: 2.1 time: 0.316535 Aug 24 14:35:21.608721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 26/43] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:21 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:21.629863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:21.632421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:21.669125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:21.672212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:21.673305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:21.675137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:21.676310 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:21.677291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.276304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:22.333284 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a6eaec26-06ba-4259-9a0e-df90a24af23a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1299 microversion: 2.1 time: 0.722262 Aug 24 14:35:22.335921 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 27/44] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:21 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1299 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:22.381435 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:22.403048 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:22.436555 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.437379 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.438174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.457302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.463133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.464730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.680706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:35:22.683920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:35:22.683920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:35:22.683920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:35:22.683920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:35:22.706201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.706963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.707419 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.709220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.710902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.711741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.780512 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:22.792125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5237587f-e6ff-4b6e-8c28-2c641962e256 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1288 microversion: 2.1 time: 0.445800 Aug 24 14:35:22.792587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for project 5981da6161ac4717a5b433c31188da53. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:35:22.802171 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 28/45] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:22 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1288 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:22.826062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:22.827910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for user c888090dd9f246a79c6be54faf480ed9 and project 5981da6161ac4717a5b433c31188da53. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:35:22.828063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:22.841157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.842793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.843799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.847066 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:22.848216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:22.849259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:22.903792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:35:22.907861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:35:23.097373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:23.115166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-83fa3fc5-748d-4353-8af3-539b6bb555f0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1278 microversion: 2.1 time: 0.310414 Aug 24 14:35:23.118906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 29/46] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:22 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:23.262133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-99625dda-7199-4660-9fc1-31ae35f58c3b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.939008 Aug 24 14:35:23.265350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 18/47] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 14:35:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 5943 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 14:35:23.284593 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:23.297930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:23.320442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:23.321403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:23.323428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:23.324533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:23.325245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:23.325913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:23.591166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945183a7-1a55-4233-af05-abb55ac82c9b", "tag": "5152e60f-ed71-495b-ad60-a57247c3b63b"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:23.674079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:23.675798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:23.681622 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:23.796459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Creating event network-changed:5152e60f-ed71-495b-ad60-a57247c3b63b for instance 945183a7-1a55-4233-af05-abb55ac82c9b on hv-cinder-75670 Aug 24 14:35:23.797922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127922) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:35:23.802641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3380f397-8c36-4880-b3c1-8d9c7cc56aa8 req-02c621c2-112e-4b1d-abac-0fe5029a945e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127922) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:35:23.809135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:23.812386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:23.814647 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:23.828746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:23.828746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:23.828746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:23.883524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.compute.rpcapi [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:35:23.889042 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] Releasing lock "compute-rpcapi-router" {{(pid=127922) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:35:23.946456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7be69072-3c32-4e87-92df-8ece8b0a8def None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.822623 Aug 24 14:35:23.948000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 30/48] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:23.975185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:23.978310 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:24.128546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.183588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-07573f23-bed4-4adf-966a-89b14a55ed69 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1273 microversion: 2.1 time: 0.914328 Aug 24 14:35:24.187369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 19/49] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:23 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1273 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:24.215446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:24.216310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:24.235424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.235936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.236389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.237144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.237621 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.238087 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.404806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.420311 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.424857 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.446739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-72249711-ebc1-4f1d-9b48-7c7d37b8d0fc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1280 microversion: 2.20 time: 0.496911 Aug 24 14:35:24.447964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 31/50] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:23 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1280 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:24.453252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:24.454762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:24.470057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.476609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.477376 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.478351 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.479063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.479791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.602324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.630765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-be9a97dc-8a36-4a22-b1b5-41f49a396959 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1299 microversion: 2.1 time: 0.431867 Aug 24 14:35:24.632287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 20/51] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:24 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1299 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:24.654407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:24.662770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:24.672701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.673508 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.674370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.675171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:24.675653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:24.676089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:24.693451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:24.720928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-387ec120-0943-4d15-a7c3-8ecaa8dbb46d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1294 microversion: 2.1 time: 0.271541 Aug 24 14:35:24.725639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 32/52] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:24 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:25.247139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:25.250782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:25.270951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:25.271230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:25.278638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:25.279967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:25.284596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:25.285349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:25.702193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:25.726537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-34bcd833-5245-4689-88dd-ff3de32cea0f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1273 microversion: 2.1 time: 0.499663 Aug 24 14:35:25.733808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 33/53] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:25 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:25.768843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:25.770118 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:25.792751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:25.794242 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:25.795645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:25.800539 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:25.804343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:25.806123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.214899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.223754 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=47 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.223992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.237144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ccaac870-c29f-4b8a-a1f3-d0efc7489ece tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 1.603348 Aug 24 14:35:26.245566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 21/54] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:24 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:26.283510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:26.284349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:26.286481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.287053 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.300407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.308709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.311609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.321494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.321494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.321494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.321494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.322039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c9948341-74a9-4fd1-a13e-cc7184ed5edd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1284 microversion: 2.20 time: 0.578936 Aug 24 14:35:26.323861 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 34/55] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:25 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1284 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:26.358839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:26.359742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:26.389868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.390745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.391488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.409326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.410234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.410996 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.651242 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.686657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c62cf535-e086-4012-ad6c-0327cddce816 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1299 microversion: 2.1 time: 0.425880 Aug 24 14:35:26.686657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 22/56] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:26 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:26.750318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:26.751051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:26.775965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.776630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.777029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.777793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:26.781218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:26.781712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:26.952440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:26.979724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4576bb34-0831-4721-a622-e72160624883 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1294 microversion: 2.1 time: 0.651051 Aug 24 14:35:26.981514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 35/57] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:26 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1294 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:27.295757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:27.298910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:27.320067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.321129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.322245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.324169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.326037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.327077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.588006 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:27.592013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:27.597051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f160c003-845b-4593-a3db-2be9a90d2dd7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.315226 Aug 24 14:35:27.597648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 36/58] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:27 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:27.608160 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:27.611832 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:27.617918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.618815 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.619482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.620696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.621353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.622139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.672865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:27.682624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-82a7e673-e903-4f16-a8c9-fffeab110f88 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.936883 Aug 24 14:35:27.683337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 23/59] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:26 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:27.708799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:27.710523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:27.725151 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.728324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.729025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.729923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:27.732823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:27.745558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:27.745862 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:27.758471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:27.760614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:27.761868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bd90c557-38b9-4994-ae7b-342c25f5e3f7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1332 microversion: 2.20 time: 0.163062 Aug 24 14:35:27.770140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 37/60] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:27 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:28.036188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:28.040551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:28.060916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.062553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.063777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.067179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.068585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.070414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.115212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:28.135870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66a42bca-c810-4e9c-892c-385e1792faea tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.433674 Aug 24 14:35:28.149953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 24/61] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:27 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:28.214616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:28.239350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2b3ab9ab-12fa-4ff4-905d-2e7e8abc6809 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1294 microversion: 2.1 time: 0.214493 Aug 24 14:35:28.240333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 38/62] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:28 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:28.636164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:28.636807 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:28.646764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.648253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.649244 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.650364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.651089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.651700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.728316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:28.729424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:28.741881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.748021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.748021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.748021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:28.748021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:28.749429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:28.974859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:28.992898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f0ac53b5-3578-4e50-8603-3099bb186dd1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.363748 Aug 24 14:35:28.993769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 25/63] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:28 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:29.006248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:29.007954 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:29.024664 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.025461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.026094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.027007 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.027656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.028260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.249575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.260910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4c3fce84-affc-401c-bab7-c6571944f614 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.547331 Aug 24 14:35:29.261101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 39/64] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:28 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:29.268051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:29.268927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:29.278813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.279560 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.280193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.281112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.281762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.282386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.477744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.488018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8befb08f-de09-4f39-b43d-1405962e5c51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.224913 Aug 24 14:35:29.503073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 40/65] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:29 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:29.509237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:29.510283 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:29.519059 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.519771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.521635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.524892 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:29.525553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:29.526164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:29.549845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.559863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.568285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.578117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0015591a-bf95-4d36-8004-9a271c876d85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1332 microversion: 2.20 time: 0.575214 Aug 24 14:35:29.580260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 26/66] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:28 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1332 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:29.805300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:29.821793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-86e1e372-5b64-4f72-9992-03d5df68cfec tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.316388 Aug 24 14:35:29.824316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 41/67] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:29 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:30.031147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:30.031879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:30.043496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.046937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.047406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.051017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.051672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.052200 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.281217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0866ee6c-9955-4a6d-851c-26234e491f75", "tag": "75d3fb08-defa-4994-842d-bfa415306f5a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:30.318414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:30.322070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.323303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.324310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.334113 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ef8e9e97-5499-4ab3-b04c-1e7dd728a4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.306979 Aug 24 14:35:30.354036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 42/68] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:30 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:30.359400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:30.360317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:30.374446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.375296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.376096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.384494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.384494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.384494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.429929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Creating event network-changed:75d3fb08-defa-4994-842d-bfa415306f5a for instance 0866ee6c-9955-4a6d-851c-26234e491f75 on hv-cinder-75670 Aug 24 14:35:30.430894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:35:30.431871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc430fae-e47d-440f-8f80-b4a9c9a08261 req-b6e9c8a5-57dc-4cea-87a9-45cfade5c5ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=127923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:35:30.434735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.435929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.436950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.438606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.439837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.440879 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.464641 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.compute.rpcapi [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:35:30.465496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] Releasing lock "compute-rpcapi-router" {{(pid=127923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:35:30.540472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8d1a98f1-65be-4dfa-8089-0d3b6f27186f None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.567289 Aug 24 14:35:30.543455 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 27/69] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:30.556776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:30.567371 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:30.593085 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.594746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.598409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:30.600046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:30.600804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:30.601501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.025756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:31.042203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3edc43dc-aadf-4b07-ae72-9d4f928d3590 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.701667 Aug 24 14:35:31.045451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 43/70] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:30 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:31.066634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:31.069347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:31.093718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.096452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.097930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.101456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.104300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.105873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.257479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:31.270476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:31.276883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:31.280752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a9380f90-835d-4d66-a8f4-010f0bfab0ce tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1332 microversion: 2.20 time: 0.232749 Aug 24 14:35:31.284149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 44/71] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:31 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:31.293676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:31.294692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:31.303072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.304535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.305221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.306504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.307198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.307880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.593858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:31.605116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4fcef118-af15-4e86-a21e-96fc518d63f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.317943 Aug 24 14:35:31.605951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 45/72] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:31 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:31.625620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:31.626273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:31.635256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.635799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.636299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:31.637081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:31.637550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:31.637978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.026716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:32.044771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-472c5188-b818-4104-95a7-75500fcdbdb0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.423018 Aug 24 14:35:32.048503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 46/73] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:31 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:32.088796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:32.089684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:32.109798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.110574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.111206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.114424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.119580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.120516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.574912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:32.589174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-eaae9619-7084-4db6-900c-a3435b571f35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 2.043778 Aug 24 14:35:32.591844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 28/74] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:30 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:32.609079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:32.610398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:32.618311 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.619218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.619916 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.620837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.621465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.622178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.752269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:32.795439 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-19e2c6ee-9d20-47a4-b622-f2f629569db1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.711818 Aug 24 14:35:32.810249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 47/75] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:32 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:32.875367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:32.876498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:32.877031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=28 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:32.901323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.902598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.903658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:32.905219 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:32.906547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:32.910879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:33.161039 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:33.196991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:33.205717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:33.219014 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-55e0a88a-781d-4c64-a35c-d975696fe2e9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1338 microversion: 2.20 time: 0.625356 Aug 24 14:35:33.220994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 29/76] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:32 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1338 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:33.238477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:33.240114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:33.254687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:33.256908 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:33.257551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:33.259493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:33.260749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:33.261859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:33.401541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:33.417905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a8076d68-f459-4c7f-a1e7-bc33f4a7855a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.604072 Aug 24 14:35:33.418908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 48/77] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:32 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:33.621291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:33.634520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:33.635888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:33.636772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:33.637513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:33.638886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:33.639773 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:33.640546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:33.872738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=8 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:33.949220 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:33.972428 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-95b48557-427e-40a8-891c-75cd9ce3735c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.358186 Aug 24 14:35:33.987026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 49/78] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:33 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:34.015082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:34.016026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:34.016926 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:34.028254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.029388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.029934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.031024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.031696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.032221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.033150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-22321519-d5b4-4d25-9167-b7b4c8a276c5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.809767 Aug 24 14:35:34.034325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 30/79] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:33 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:34.281423 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:34.283795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:34.302056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.302056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.302877 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.304595 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.305925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.307223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.415427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=40 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.435069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:34.451739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b458bb6a-0b64-4e18-bb0e-a2bb60457801 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.441525 Aug 24 14:35:34.461979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 50/80] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:33 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:34.468730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:34.468730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:34.473634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.474624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.475960 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.477226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:34.477946 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:34.478694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:34.939463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:34.955406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a591d5a2-fc80-4191-bd74-98e4ac057437 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.498441 Aug 24 14:35:34.956482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 51/81] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:34 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:35.020052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:35.020052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:35.021980 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.023227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.023659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.024513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.024972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.025394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.221549 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:35.249328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:35.255327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:35.260151 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-43cf25a4-26b7-4a63-bcec-0983d75d66d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 1.015488 Aug 24 14:35:35.261710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 31/82] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:34 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:35.276222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:35.277803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:35.291877 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.293089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.293765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:35.294538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.296214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.297158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.298263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.304213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c2f1cc77-d859-4f63-b8c3-d7b89f83379d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.292194 Aug 24 14:35:35.317580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 52/83] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:35 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:35.501582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:35.503619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:35.525882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.527233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.527959 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.530688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.532387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.534034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.574818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:35.874058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:35.888722 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9f62255a-3bd2-45ef-b087-c25177d6be59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.623365 Aug 24 14:35:35.889330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 32/84] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:35 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:35.899117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9601091-8514-4244-b7ae-a6921fd9fa7a", "tag": "6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:35.921037 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:35.921814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:35.922449 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:35.936318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] Creating event network-changed:6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0 for instance a9601091-8514-4244-b7ae-a6921fd9fa7a on hv-cinder-75670 Aug 24 14:35:35.943167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-270e5917-97ef-46d3-86e9-72daa4a71759 req-e3e65b65-cea5-4be8-9b21-7bac0135055f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052223 Aug 24 14:35:35.945277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 33/85] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:35.987507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:35.992030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:36.011281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.012665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.013545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:36.020442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.021521 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.025055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:36.040022 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:36.049722 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3e5a1fe4-beeb-4992-b504-50bf5eeb0c60 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.557779 Aug 24 14:35:36.051044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 53/86] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:35 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:36.304931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:36.306518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:36.327209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.328423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.329434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:36.331304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.332443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.333456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:36.698087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:36.719410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:36.723475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:36.726571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f7a80463-ee48-47bc-86cb-de65de6b9dd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.428091 Aug 24 14:35:36.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 54/87] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:36 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:36.757007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:36.760773 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:36.766742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.767244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.767687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:36.768484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:36.769260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:36.769698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.107922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:37.136211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2251439e-cc15-4574-9e9f-f33b5f2f598f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.390671 Aug 24 14:35:37.141148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 55/88] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:36 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:37.156778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:37.205077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.206852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.207950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.254248 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] Creating event network-changed:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:35:37.275725 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-cee81af2-5419-4324-84c6-7f2bae4a9416 req-701a9c81-d1d0-40ed-9eca-d12816c9712b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131818 Aug 24 14:35:37.280193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 56/89] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:37.304887 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.306357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:37.337683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.338549 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.339637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.340555 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.341389 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.342160 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.579610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:37.589814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6c7d9f5c-e28f-4146-962c-8b6e6f69485a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 1.612856 Aug 24 14:35:37.592351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 34/90] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:35 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:37.618617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.619503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:37.632081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.632635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.633081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.633830 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.634597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.635263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.687695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:37.700521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c737036b-7d91-4369-b881-aa6e8221928b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.416708 Aug 24 14:35:37.701535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 57/91] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:37.771689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:37.773516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:37.786324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.787622 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.789648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.791399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:37.795122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:37.796222 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:37.923756 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:37.940590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1ca01e57-fb26-4c7c-915f-4daea6f047c1 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.346303 Aug 24 14:35:37.950590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 35/92] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:38.005696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:38.016315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:38.017903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:38.019159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a13fc81f-e9f2-405b-b701-f3f59d235f0d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.258300 Aug 24 14:35:38.019779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 58/93] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:37 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:38.042185 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27d2351-dcbf-4015-a512-f81677b27a58", "tag": "948fcd1f-2483-4103-8b1a-57ec06831af6"}, {"name": "network-changed", "server_uuid": "c0a79bb8-4962-4c32-bafd-b5759bea2607", "tag": "064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:38.063500 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.064578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.065195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.088343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Creating event network-changed:948fcd1f-2483-4103-8b1a-57ec06831af6 for instance f27d2351-dcbf-4015-a512-f81677b27a58 on hv-cinder-75670 Aug 24 14:35:38.088343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] Creating event network-changed:064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874 for instance c0a79bb8-4962-4c32-bafd-b5759bea2607 on hv-cinder-75670 Aug 24 14:35:38.095923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-5576a1fd-81f4-48cb-ad44-3c344b7f690d req-fdacf154-8c55-4f42-9532-76224c8ebf02 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066064 Aug 24 14:35:38.097055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 36/94] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:38.179553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:38.184568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:38.186695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.187192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.187843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.188576 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.189043 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.189541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.516479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:38.527213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e8c0b89b-02f9-4382-b4f3-90fbbc1141df tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.351954 Aug 24 14:35:38.539684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 59/95] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:38 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:38.635308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:38.636653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:38.648415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.649422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.650118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.651269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.652124 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.652898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.729652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:38.730764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:38.738687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.739509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.740108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.741693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.743040 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.743537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.961720 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:38.970817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e6110d66-4b84-419a-bd3a-71baa377e1eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.248161 Aug 24 14:35:38.972240 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 60/96] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:38 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:38.979446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:38.984073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:38.996446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:38.997256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:38.997868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:38.998636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.001513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.002355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.014983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.033036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-148bd333-5607-44b9-bbdd-6597edc3abb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.407077 Aug 24 14:35:39.053059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 37/97] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:38 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:39.077105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:39.078780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:39.089533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.091381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.092984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.094957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.096490 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.097587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.363323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.410054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7105dd1f-f378-44d3-9a60-a0355d60c3ca tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.436615 Aug 24 14:35:39.412019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 61/98] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:38 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:39.474176 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.485026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.487678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.489447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5b4ead6e-ff1a-4270-8ec6-afe2d54f13ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.424255 Aug 24 14:35:39.490789 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 38/99] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:39 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:39.577357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:39.578970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:39.604226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.609380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.610425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.611339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.612819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.615114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.842900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:39.846557 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945183a7-1a55-4233-af05-abb55ac82c9b", "name": "network-vif-plugged", "status": "completed", "tag": "5152e60f-ed71-495b-ad60-a57247c3b63b"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:39.856541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-42bcfdf6-5987-4779-82f7-7ca38c7d41c0 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.307741 Aug 24 14:35:39.857895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 62/100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:39 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:39.861780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:39.862430 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:39.862921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:39.876375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] Creating event network-vif-plugged:5152e60f-ed71-495b-ad60-a57247c3b63b for instance 945183a7-1a55-4233-af05-abb55ac82c9b on hv-cinder-75670 Aug 24 14:35:39.882901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-eae3ca7d-d5ff-4330-b817-d51236e0ac72 req-34f95d3b-1a70-4111-97dc-f29010730b25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202032 Aug 24 14:35:39.883711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 39/101] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:35:40.016879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:40.018942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:40.036121 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.037624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.039206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.040406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.041082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.041805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.077362 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:40.078451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:40.088960 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.089464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.089974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.090794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.091266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.091698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.262161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.269350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-03ce51c2-7a1b-48f8-a020-6bffd79446dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.262438 Aug 24 14:35:40.269957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 63/102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:40 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:40.341108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.344643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:40.356384 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-843bc7f4-208b-4fec-902c-bfcf01e63149 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.286138 Aug 24 14:35:40.368689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 40/103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:40 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:40.434756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:40.435588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:40.442425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.442928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.444759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.444759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.444759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.445487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.534033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:40.534675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:40.537059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:40.543605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.544112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.544543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.545283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.546075 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.546487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.649623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.658477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b784f202-8d61-4128-9443-cdd346fefbe8 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.228038 Aug 24 14:35:40.659078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 64/104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:40 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:40.721144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.738998 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.748616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:40.748616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dc1f840a-ab8c-4eb1-8f32-c30df9128129 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.215823 Aug 24 14:35:40.748616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 41/105] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:40 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:40.884308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:40.886213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:40.898698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.909077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.909077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:40.909077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:40.909077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:40.909817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.215036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:41.224916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-358c4bda-1207-4a4f-8d68-6818ff9b70ae tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.348462 Aug 24 14:35:41.230656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 65/106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:40 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:41.304067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:41.306635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:41.325829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.326674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.327420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.329010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.329930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.330601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.408315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:41.409546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:41.432186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.432700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.434478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.435233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.436088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.439460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.732533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:41.744264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1b60c972-e86e-442c-ba4a-2e617bd65cab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.353202 Aug 24 14:35:41.745250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 66/107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:41 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:41.750812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:41.752147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:41.761346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.761850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.768370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:41.768370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:41.768370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:41.768370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.012060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.019035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-eb507e52-6dc1-451e-853d-b3e7f9d3b6af tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.728388 Aug 24 14:35:42.030109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.030981 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 42/108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:41 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:42.036584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6321b38f-e086-466c-84a1-c5323194f240 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.290206 Aug 24 14:35:42.037195 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 67/109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:41 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:42.041039 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:42.041667 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:42.048291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.048797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.049243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.049970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.050455 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.050891 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.308587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:42.309218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:42.314654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:42.316655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.317155 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.317590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.318341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.318801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.320148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.496495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.504800 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-94985f31-d029-4104-805a-e28ba0be2c16 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.199817 Aug 24 14:35:42.505436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 68/110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:42 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:42.550612 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.559876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.561448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:42.562685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-205ee331-c1fd-423d-b7c3-701dd45254a3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.526413 Aug 24 14:35:42.563275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 43/111] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:42 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:42.797958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:42.799159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:42.826774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.827474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.828212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:42.830088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:42.841027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:42.841914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.049312 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:43.050316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:43.061775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.063003 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.063796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.065155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.066487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.068096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.110958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:43.151400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dbece436-2039-4561-a5b1-f4832291ddb5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.368956 Aug 24 14:35:43.152383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 69/112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:42 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:43.175571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:43.176637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:43.188441 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.189334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.190972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.192817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.193607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.195271 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.325359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:43.337770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1a307f43-0277-4c07-9cc2-c4dd59834f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.296732 Aug 24 14:35:43.338765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 44/113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:43 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:43.510691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:43.519761 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.530169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:43.531440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:43.541752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7a1e67e0-22f7-4ed1-80ff-2e6ac88f15ad tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.372516 Aug 24 14:35:43.544414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 70/114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:43 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:43.556987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.558167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.560544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.567336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.567336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.567336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.591341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:43.591956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:43.608387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.610691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.611408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:43.612521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:43.613599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:43.614356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.013386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.056286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-73d0896a-320d-402d-8662-ca00f029a914 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.522808 Aug 24 14:35:44.056286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 45/115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:43 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:44.179466 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:44.182846 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:44.205403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.206829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.207775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.214944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.216739 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.218810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.232052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.256860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.259524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.282228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f452445b-8c9e-4add-8acd-260f46b4f4c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.677759 Aug 24 14:35:44.282228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 71/116] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:43 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:35:44.375183 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:44.377255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:44.395220 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.396348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.399232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.399232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.399500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.399772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.781303 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.814540 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a7de4daa-4629-478f-8333-81fe520d3e56 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.442800 Aug 24 14:35:44.816666 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 72/117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:44 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:44.832305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:44.846704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:44.862526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.863872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.864967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.866953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:44.867944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:44.868786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:44.891280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:44.909679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-04fd3023-6b33-46be-a86e-7966d5119e88 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.738409 Aug 24 14:35:44.911657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 46/118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:44 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:45.066932 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:45.073454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:45.079677 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e94a9555-c444-48d0-9ac0-14cd8423772e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.259412 Aug 24 14:35:45.080578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:45.095954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 73/119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:44 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:45.097280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.098460 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.099133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.102068 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.102068 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.102068 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.283487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:45.299160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8d0b654b-0f1f-4e64-a40e-d9aaaa74cf95 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.231977 Aug 24 14:35:45.302928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 47/120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:45 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:45.314140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:45.314140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:45.318120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.319718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.320637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.322016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.322897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.323787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.581947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:45.592340 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:45.594487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:45.595680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-be5b0207-ea7a-48b0-85cd-8d6013f6bd29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.304088 Aug 24 14:35:45.596295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 74/121] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:45 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:45.850026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:45.850968 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:45.858594 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.859417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.859977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.861073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.861784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.862803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.957738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:45.958602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:45.976162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.978654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.979776 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:45.981849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:45.985466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:45.986186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.083818 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:46.095320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8ddf619a-1b81-4127-acf5-f722f0606153 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.249023 Aug 24 14:35:46.109774 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 48/122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:45 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:46.115292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866ee6c-9955-4a6d-851c-26234e491f75", "name": "network-vif-plugged", "status": "completed", "tag": "75d3fb08-defa-4994-842d-bfa415306f5a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:46.126214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.126758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.127201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.142160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] Creating event network-vif-plugged:75d3fb08-defa-4994-842d-bfa415306f5a for instance 0866ee6c-9955-4a6d-851c-26234e491f75 on hv-cinder-75670 Aug 24 14:35:46.149108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-f37089a7-01b6-4acc-94a8-67fb0b1001fa req-26b430af-c2f6-40b2-a39d-2bef30f91ed7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Aug 24 14:35:46.151393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 49/123] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:46.173364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:46.174138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:46.186280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.186785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.187232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.188016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.188484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.188917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.266807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:46.312884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cc44d9e5-5f5f-451c-90ed-f14747ee548d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.357800 Aug 24 14:35:46.321351 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 75/124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:45 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:46.342264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:46.343790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:46.378189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.379073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.379831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.381107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.382040 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.382813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.414847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:46.431021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d3086954-5a1f-4c4b-a75f-509183a4525f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.275538 Aug 24 14:35:46.432256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 50/125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:46 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:46.578281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:46.588938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-07f683c6-ad3d-4bfc-b969-0754fd91abf3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.255535 Aug 24 14:35:46.602587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 76/126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:46 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:46.622464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:46.623810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:46.637913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.638900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.642289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.643061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:46.643843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:46.644523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:46.989589 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.027444 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.030700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.032799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ae843d9c-a6e3-45f1-a4a7-92caa8776fec tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.416564 Aug 24 14:35:47.033829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 51/127] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:46 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:47.116165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:47.117339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:47.123489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.123976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.124409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.125119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.125608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.126066 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.297226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.305780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9f2253aa-fafc-4310-88d1-45e2b50571de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.193337 Aug 24 14:35:47.311306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 77/128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:47 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:47.347364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:47.347986 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:47.355138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.355632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.356064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.356941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.357438 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.357860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.466442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:47.467580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:47.474306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.475105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.476572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.477611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.478279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.478962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.603569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.614346 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-16f285f8-2df6-4554-97bd-8adccef9dbe0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.270960 Aug 24 14:35:47.614940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 52/129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:47 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:47.621795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:47.623263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:47.632102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.632983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.633733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.634968 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:47.635729 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:47.636644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:47.769446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.785882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1e89e899-7707-4ea4-9a3e-4b4e0067aa40 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.323197 Aug 24 14:35:47.798601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 78/130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:47 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:47.866046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:47.875325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0f553f02-8517-4d3a-afb0-bbe165aa9775 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.257592 Aug 24 14:35:47.876074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 53/131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:47 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:48.059007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:48.060495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:48.070714 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.071211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.071845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.072568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.073068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.073751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.178654 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9601091-8514-4244-b7ae-a6921fd9fa7a", "name": "network-vif-plugged", "status": "completed", "tag": "6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:48.195497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.195987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.196417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.242596 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] Creating event network-vif-plugged:6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0 for instance a9601091-8514-4244-b7ae-a6921fd9fa7a on hv-cinder-75670 Aug 24 14:35:48.266869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-957fe5d7-d0c6-4c83-9431-dc0229ad7b4c req-6f3c9409-20eb-415b-9be7-dc72ce3097ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084819 Aug 24 14:35:48.266869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 54/132] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:48.283766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:48.300898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:48.307484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:48.313015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0428f919-be72-42d6-85f0-27c28bd83cd9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.256391 Aug 24 14:35:48.314265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 79/133] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:48 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:48.336027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:48.337106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:48.345958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.346741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.347312 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.348178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.349060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.349259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.539737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:48.553848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8c933ef2-d951-4f56-80bb-a6e6c4759662 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1320 microversion: 2.1 time: 0.225322 Aug 24 14:35:48.554969 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 55/134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:48 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:48.657727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:48.658524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:48.670723 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.671235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.674360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.674360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.674360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.674360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.825692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:48.831555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:48.859153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.860719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.863179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.864055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.867363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.870536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:48.880495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.888285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-52113c67-66cf-437f-904a-78b2b57037bb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.234255 Aug 24 14:35:48.889445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 80/135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:48 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:48.915487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:48.917322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:48.930851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.931362 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.931774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:48.933374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:48.933374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:48.933672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.141760 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.150972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a5869f6c-9a64-49ff-b664-04e9fb2f200e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.243314 Aug 24 14:35:49.151783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 81/136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:48 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:49.202334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.212698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-edad6a02-f7f8-4f68-af00-bac5d989d3cc tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.394836 Aug 24 14:35:49.215418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 56/137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:48 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:49.355238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:49.357831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:49.368032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.368778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.369407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.370363 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.372167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.372896 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.575904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:49.581774 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:49.583758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.584384 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.585612 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.586474 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.587197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.587842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.642836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.652801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.654326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.655478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-31c061e5-f6d8-4fee-bf33-e6b3a2dab444 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.305799 Aug 24 14:35:49.672537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 82/138] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:49 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:49.863409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:49.873913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-60b1e01f-f909-4544-a15e-38aa66c0418b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1513 microversion: 2.1 time: 0.301903 Aug 24 14:35:49.874768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 57/139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:49 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:49.901279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:49.905360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:49.914556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.915159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.915603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.916318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.916781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.917217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.919040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:49.919580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:49.925922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.926414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.929863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.929863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:49.929863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:49.929863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:49.985428 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'flavor' on Instance uuid 0866ee6c-9955-4a6d-851c-26234e491f75 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:35:50.103996 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:50.106929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.114562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c3e4fae1-99f3-4610-9756-87b425c257bf tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.199223 Aug 24 14:35:50.129669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 58/140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:49 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:50.173201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:50.173874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:50.181087 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.181563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.182099 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.182825 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.183363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.183915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.348470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:50.356918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ba60a6bd-8791-4dd9-b133-6ff221093f80 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1367 microversion: 2.1 time: 0.187652 Aug 24 14:35:50.357514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 59/141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:50 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:50.362927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:50.366453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:50.371926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.372418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.373109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.374752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.375425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.376081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.561955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:50.573968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7ee3c9cb-6fb7-4e6d-9814-49fffcfa6d7a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75/action" status: 200 len: 32 microversion: 2.1 time: 0.680587 Aug 24 14:35:50.577724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 83/142] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:35:49 2022] POST /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75/action => generated 32 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:35:50.581751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a02db480-0813-4a35-8f3d-99b2dccdbf7e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.222053 Aug 24 14:35:50.594033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 60/143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:50 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:50.595308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "name": "network-vif-plugged", "status": "completed", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}, {"server_uuid": "f27d2351-dcbf-4015-a512-f81677b27a58", "name": "network-vif-plugged", "status": "completed", "tag": "948fcd1f-2483-4103-8b1a-57ec06831af6"}, {"server_uuid": "c0a79bb8-4962-4c32-bafd-b5759bea2607", "name": "network-vif-plugged", "status": "completed", "tag": "064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:50.595909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:50.601770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:50.615300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.615500 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.617896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.618164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.618164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.618322 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.619979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.621562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.622807 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.655723 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Creating event network-vif-plugged:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:35:50.658994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Creating event network-vif-plugged:948fcd1f-2483-4103-8b1a-57ec06831af6 for instance f27d2351-dcbf-4015-a512-f81677b27a58 on hv-cinder-75670 Aug 24 14:35:50.660050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] Creating event network-vif-plugged:064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874 for instance c0a79bb8-4962-4c32-bafd-b5759bea2607 on hv-cinder-75670 Aug 24 14:35:50.684639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-fbf053a8-27b5-4dd0-8acc-9e8db9b1c161 req-7a6783fc-bd56-4f7a-9ba6-36f13b51619b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107075 Aug 24 14:35:50.686527 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 84/144] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:50.698265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:50.699978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:50.715490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.717912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.721157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.721157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:50.721390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:50.722681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:50.985466 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:50.996966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2b886778-1c64-4b55-8603-b002f94c5361 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.411080 Aug 24 14:35:51.010037 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 61/145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:50 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:51.065218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:51.078111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:51.080263 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:51.082357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2139f1b1-58c6-4f48-8d26-95cf20c97dae tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.391446 Aug 24 14:35:51.083481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 85/146] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:50 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:51.140371 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:51.142786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:51.152042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.153451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.154484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.155523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.156383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.157072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.402537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:51.406357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:51.420989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.421846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.423203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.424735 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.425869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.426734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.436586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:51.772122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:51.791105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c9046424-1502-4346-8f86-24cc50c57fc6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1558 microversion: 2.1 time: 0.401417 Aug 24 14:35:51.794355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 86/147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:51 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1558 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:51.807675 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:51.809645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:51.823934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.828349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.828349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.828349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:51.828349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:51.830505 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:51.972031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:51.984402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dd8492e2-81d0-40e3-9044-04e9f464757b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.848160 Aug 24 14:35:52.002862 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 62/148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:51 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:52.027947 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:52.029820 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:52.045029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.046588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.049964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.052578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.055125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.056676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.349925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d1217354-e072-461b-b82f-2a1e31d5cc2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344684 Aug 24 14:35:52.351418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 63/149] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:35:52 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:52.368318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:52.369452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:52.389204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.390202 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.390844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.392095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.393122 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.393763 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.659505 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:52.680221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0a43d6cf-6119-46d1-99ea-79f98f818ef5 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.883656 Aug 24 14:35:52.681776 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 87/150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:51 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:52.692559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:52.694850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:52.711639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.712581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.713340 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.715065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:52.716275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:52.717085 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:52.733531 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:52.765155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-303ce612-3341-4847-ba6c-4c653848e2f8 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.410391 Aug 24 14:35:52.768422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 64/151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:52 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:53.026518 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:53.027462 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:53.033790 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.034614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.035102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.035828 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.036453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.037047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.336823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:53.348205 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-63f3e67b-1074-45fe-ad62-86cb63f3a048 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1362 microversion: 2.1 time: 0.326683 Aug 24 14:35:53.362437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 65/152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:53 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:53.395052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:53.406292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:53.407872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:53.409055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-75776e6a-ecf8-4cde-b6bd-81a088daf62d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1405 microversion: 2.20 time: 0.725280 Aug 24 14:35:53.409623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 88/153] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:52 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1405 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:53.713557 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:53.714673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:53.723156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.724862 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.726598 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.727591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.728306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.729191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.809317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:53.810485 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:53.822540 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.823924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.824726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.826038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:53.827108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:53.827871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:53.927217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:53.939026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-69de660f-128d-4a5a-b798-9c170b95fb85 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1315 microversion: 2.1 time: 0.228705 Aug 24 14:35:53.940246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 66/154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:53 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:54.345087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:54.369504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8c7b82d8-9704-4128-aadf-5cb9d75b687d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.568285 Aug 24 14:35:54.370404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 89/155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:53 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:54.407824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:54.422454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:54.438774 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.439718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.440923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.441957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.443988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9601091-8514-4244-b7ae-a6921fd9fa7a", "tag": "6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:54.445314 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.446991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.472618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.474146 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.474817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.492780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] Creating event network-changed:6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0 for instance a9601091-8514-4244-b7ae-a6921fd9fa7a on hv-cinder-75670 Aug 24 14:35:54.499134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-74bc9c8d-e9e0-4fb1-b8a7-1349b3279d84 req-05292ea6-2846-4a49-b32e-288e6852ee89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059791 Aug 24 14:35:54.500477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 90/156] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:35:54.510517 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:54.512287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:54.519593 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.520563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.521287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.523534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.524269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.524930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.779628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:54.802138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:54.815494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:54.822662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:54.831660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-644cf04b-d7a5-413c-904c-57e27fe37c71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1597 microversion: 2.20 time: 0.329167 Aug 24 14:35:54.837217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 91/157] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1597 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:35:54.880977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bb97605d-6c2e-4c1d-ab7c-1feced15089d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1547 microversion: 2.1 time: 0.511346 Aug 24 14:35:54.887003 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 67/158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1547 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:54.900652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:54.902610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:54.928156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:54.929130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.929794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:54.930066 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.933202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.934598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.935417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.936191 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.950331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.951276 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.953690 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:54.955872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:54.956776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:54.958824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.063977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7121111b-88c4-42b9-ab70-73cf70ccb7cc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143864 Aug 24 14:35:55.064643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 68/159] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:35:55.078214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:55.078833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:55.102241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.103043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.103692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.104821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.107252 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.124008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.336984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-459b79d4-1db7-4ec6-83b2-bd9f49f9a437 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.443759 Aug 24 14:35:55.339718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 92/160] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-interface => generated 284 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:35:55.403281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:55.403908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:55.420145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.421319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.421319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.421822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.432335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.433011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.778827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:55.806067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ea791eba-a4ec-4ba0-982f-a393b061f194 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.406545 Aug 24 14:35:55.806332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:55.816466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 93/161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:55 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:55.817819 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-93249725-aab8-47ff-ba26-84875b298671 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1501 microversion: 2.1 time: 0.751729 Aug 24 14:35:55.818751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 69/162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:55 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1501 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:56.844836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:56.845945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:56.875655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:56.876825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:56.877804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:56.879410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:56.888294 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:56.889598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:57.204029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:57.220046 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2a2ad65b-fe7c-4f7a-b2c6-db6bd85e7f82 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.381762 Aug 24 14:35:57.221908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 94/163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:56 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:58.255793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:58.256920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:58.264145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:58.264869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:58.265476 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:58.266477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:58.267101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:58.267699 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:58.543471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a79bb8-4962-4c32-bafd-b5759bea2607", "tag": "064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:58.582397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:35:58.603358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:58.606215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:58.607078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:58.644859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-21f3788b-60a6-46fc-8d66-7474e40cce4a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.392608 Aug 24 14:35:58.649775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 70/164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:58 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:58.671250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] Creating event network-changed:064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874 for instance c0a79bb8-4962-4c32-bafd-b5759bea2607 on hv-cinder-75670 Aug 24 14:35:58.703944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-6ab4336a-dcb7-4fef-b4c3-3e17c6dc9d80 req-6e52f1cf-81c7-4f1f-af3e-4b8419c6e454 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169129 Aug 24 14:35:58.707373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 95/165] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:58.923939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dd3c9f6-f4f7-4154-8551-906177bfd536"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:35:58.930912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:58.949235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:58.954175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:58.954860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:58.956100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:58.961260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:58.962288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:59.689627 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:59.690598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:35:59.698841 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:59.699508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:59.700049 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:59.701061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:59.701632 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:59.702201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:00.023927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:00.043810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-817623e8-59f2-4987-a30f-f77acd7f5180 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.356781 Aug 24 14:36:00.044866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 96/166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:35:59 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:00.725100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:00.735810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:00.736568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:00.737188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:00.750161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] Creating event network-changed:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:36:00.755729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-9543ab5b-5ec1-4a5d-ae04-bcf586c6a654 req-b0109f9c-6c01-4527-8482-a3500ceaa02a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Aug 24 14:36:00.756957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 97/167] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:36:01.082324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:01.083577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:01.098595 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:01.099474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:01.100894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:01.102215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:01.103327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:01.104107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:01.305343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:01.313823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3e391e63-03ce-474e-948c-d58f3dc43173 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.239487 Aug 24 14:36:01.314497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 98/168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:01 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:02.337510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:02.338242 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:02.345858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:02.346658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:02.347107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:02.347897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:02.348305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:02.348733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:02.507789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:02.516981 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-97bd57bc-8bf4-48ca-8ae3-7f7813e0f085 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.184758 Aug 24 14:36:02.517572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 99/169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:02 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:03.031154 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-74d030f5-d500-4c98-b930-6a435d287e97 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "POST /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.113216 Aug 24 14:36:03.032362 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 71/170] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:35:58 2022] POST /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58/os-volume_attachments => generated 194 bytes in 4118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:03.553917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:03.554612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:03.561417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:03.561722 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:03.562403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:03.563307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:03.563772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:03.564197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:03.714665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:03.723695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ed8d11b8-f070-4564-a4ae-3b3f1bed05d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.174301 Aug 24 14:36:03.724399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 100/171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:03 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:04.748446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:04.749306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:04.752415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.759336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:04.759944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:04.760480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:04.761300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:04.761846 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:04.762410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:04.966592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:04.975760 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6364dc5d-a11e-443a-a6e0-49fde17ebb0d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.231851 Aug 24 14:36:04.976923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 72/172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:04 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:06.001343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:06.002728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:06.013983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:06.013983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:06.014826 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:06.015828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:06.016483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:06.017179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:06.205486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:06.224951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-71e394d5-472c-4641-a86b-f799aeca158b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.228208 Aug 24 14:36:06.237307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 101/173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:05 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:06.287194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-63215562", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "networks": [{"uuid": "bef4335d-6a3c-4811-b510-01e33217e631"}]}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:06.377408 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] validate_networks() for [('bef4335d-6a3c-4811-b510-01e33217e631', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:36:06.972325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:36:06.972670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:36:06.973134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:36:06.973534 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:36:06.973942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:36:06.987069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:06.987616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:06.988060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:06.988803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:06.989262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:06.989679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:07.011957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Getting quotas for project aa7908a26d224db1bf2e074c5f25b315. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:36:07.017248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Getting quotas for user 6e729065f1524fd9bf9ef3c6b42f7a5e and project aa7908a26d224db1bf2e074c5f25b315. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:36:07.030961 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:36:07.033374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:36:07.265624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-594413e4-4bae-4d9d-b803-a1ed590ecc25 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985774 Aug 24 14:36:07.266566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 73/174] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:36:07.269654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:07.273290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:07.284524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:07.286472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:07.287865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:07.288435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0fa2fe30-6840-40d0-86cf-1c270712c031 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:07.290162 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0fa2fe30-6840-40d0-86cf-1c270712c031 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:07.290826 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:07.291951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:07.293136 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:07.370239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0fa2fe30-6840-40d0-86cf-1c270712c031 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:07.382690 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0fa2fe30-6840-40d0-86cf-1c270712c031 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1212 microversion: 2.1 time: 0.103289 Aug 24 14:36:07.389768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 74/175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:07 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:07.551715 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:07.561394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e00c4a07-7d0c-474c-acdd-695260761877 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.300590 Aug 24 14:36:07.562186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 102/176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:07 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:08.405544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-946df294-c157-4444-a1da-43c713ba5e0f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:08.406615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-946df294-c157-4444-a1da-43c713ba5e0f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:08.474727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-946df294-c157-4444-a1da-43c713ba5e0f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:08.483232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-946df294-c157-4444-a1da-43c713ba5e0f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1212 microversion: 2.1 time: 0.082206 Aug 24 14:36:08.483860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 75/177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:08 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:08.595791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:08.596562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:08.604582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:08.605129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:08.605679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:08.608034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:08.608871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:08.609308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:08.842704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:08.856991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-43912860-ad11-463e-a8a7-484631fb151d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.265009 Aug 24 14:36:08.857802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 103/178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:08 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:09.518036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:09.518988 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:09.528199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:09.528768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:09.529218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:09.529943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:09.530439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:09.530874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:09.624619 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:09.635338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5e9c3779-7f84-47b2-88bb-286e437afc74 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1216 microversion: 2.1 time: 0.121366 Aug 24 14:36:09.636055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 76/179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:09 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:09.897574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:09.899232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:09.906463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:09.907159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:09.907650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:09.908541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:09.909175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:09.909645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:10.136167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:10.158148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2d59ce71-e73b-4a2b-9a5f-5beb97c6b0be tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.270125 Aug 24 14:36:10.159635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 104/180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:09 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:10.673452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:10.678829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:10.687747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:10.688714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:10.689329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:10.690440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:10.691142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:10.691870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:10.720376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.792982 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:10.805771 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e57fa5b8-e90f-47c3-b721-d93725fc78c4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1264 microversion: 2.1 time: 0.140596 Aug 24 14:36:10.806714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 77/181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:10 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:11.190677 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:11.191553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:11.199481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:11.203808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:11.203808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:11.203808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:11.203808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:11.204486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:11.210067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.456016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:11.465366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d8a9eefa-558f-4d55-b916-8df2ad465b3c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.278802 Aug 24 14:36:11.466666 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 105/182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:11 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:11.841582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:11.844750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:11.856648 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:11.857697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:11.858415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:11.859599 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:11.860379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:11.861300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:11.968659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:11.978346 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a55e4368-f981-48e8-864e-e02203ea926d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1282 microversion: 2.1 time: 0.145838 Aug 24 14:36:11.980792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 78/183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:11 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:12.496661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:12.499645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:12.512562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:12.513187 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:12.513671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:12.514533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:12.515109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:12.515650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:12.874130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:12.886462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-14dae522-2f50-457b-b69f-69b0be3ef72f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.400390 Aug 24 14:36:12.887216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 106/184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:12 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:13.008404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:13.009485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:13.018249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:13.018767 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:13.019273 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:13.020028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:13.020514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:13.020937 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:13.242693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:13.252320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66907c18-fc1f-45fa-a615-755e27853b7d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.250249 Aug 24 14:36:13.256310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 79/185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:13 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:13.945646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:13.953387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:13.986789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:13.987577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:13.988345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:13.989579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:13.990174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:13.991405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:14.191734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:14.210398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2021e3b2-7dec-459a-a9f3-e3552d2ec370 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.286252 Aug 24 14:36:14.211613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 107/186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:13 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:14.276004 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:14.276840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:14.284794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:14.285389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:14.285837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:14.286630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:14.287100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:14.288106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:14.640483 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:14.650743 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-22812893-695d-431b-8c80-4b40ea5b184b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.379414 Aug 24 14:36:14.653249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 80/187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:14 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:15.235316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:15.235629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:15.236390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:15.236542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:15.238155 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=79 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:15.243174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.243670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.244101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.244252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.244651 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.245008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.245159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.245468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.245781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.246267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.246474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.247462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.281444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:36:15.563165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:15.574071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-68271b44-5f57-47c6-b947-0ed75f8324d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.342833 Aug 24 14:36:15.575342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 81/188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:15 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:15.580591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbaec5f-8289-44c1-b13d-aa8a3410662a", "tag": "5057c58c-fca2-47a0-aca2-10e64cf1195f"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:15.592166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.592678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.593304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.623487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] Creating event network-changed:5057c58c-fca2-47a0-aca2-10e64cf1195f for instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a on hv-cinder-75670 Aug 24 14:36:15.626832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-5f3121d5-932d-4f75-bc5c-6856b9c460c2 req-59c39667-1a0a-48f0-bb1d-c1f38ade4691 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050036 Aug 24 14:36:15.627541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 82/189] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:15.675620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:15.676325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:15.682972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.686158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.686158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.686158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.686158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.686505 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.792460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-18f1ce71-4989-486a-9135-7e76d2311047 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 204 len: 0 microversion: 2.1 time: 0.563311 Aug 24 14:36:15.795104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 108/190] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:36:15 2022] DELETE /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:15.811617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:15.817013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:15.830101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.830749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.831316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.832185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:15.832834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:15.833549 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:15.913840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:15.922178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-44897d26-d34d-47ae-81be-64fe714dde98 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.251070 Aug 24 14:36:15.922893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 83/191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:15 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:16.029037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:16.041095 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2e829452-3914-4401-9f8a-82163e95e82a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.238243 Aug 24 14:36:16.041707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 109/192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:15 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:16.604895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:16.608857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:16.612520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:16.613010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:16.613439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:16.614175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:16.614626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:16.615040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:16.810479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:16.819421 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e25f8c7d-16b2-4811-989c-d8d43d65c0cd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.217911 Aug 24 14:36:16.820034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 84/193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:16 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:16.945618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:16.946374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:16.953603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:16.954323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:16.954967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:16.955825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:16.956401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:16.956916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:17.070558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:17.071704 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:17.075303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.083573 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:17.085111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:17.085786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:17.086996 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:17.087708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:17.088435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:17.112494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:17.123320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ae0e7969-3cdd-4963-bfe5-d319c17b9c72 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.183143 Aug 24 14:36:17.123933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 110/194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:16 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:17.262475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:17.271583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-23dcb851-0ce9-475f-abae-97431ef2050e tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.209215 Aug 24 14:36:17.272446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 85/195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:17 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:17.853156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:17.862609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:17.875994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:17.876766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:17.879806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:17.879806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:17.879806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:17.879806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:18.097165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:18.110515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bf497999-abee-4a22-ba25-27ef9cd57337 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.270005 Aug 24 14:36:18.110515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 111/196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:17 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:18.150663 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:18.151275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:18.158290 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:18.158781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:18.159216 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:18.159915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:18.160365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:18.160781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:18.299419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:18.300476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:18.314224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:18.315107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:18.315893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:18.317137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:18.317966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:18.318436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:18.319721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:18.330247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8b17e8c3-e305-41cd-9813-f967c36d72ca tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.184025 Aug 24 14:36:18.332029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 86/197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:18 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:18.501357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:18.512109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9b79ec7a-ab3b-4e9b-b228-20cbc4abc754 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.220089 Aug 24 14:36:18.512719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 112/198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:18 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:19.140467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:19.141090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:19.143119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=10 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.149839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.150440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.150878 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.151595 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.152061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.152484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.299834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:19.308428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6abf1c91-bcff-43cb-9022-d870008ecc83 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.171935 Aug 24 14:36:19.309029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 87/199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:19 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:19.359147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:19.359772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:19.367649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.368303 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.368751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.369556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.370038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.370612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.536002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:19.536526 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:19.544596 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.545129 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.545756 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.546521 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:19.546983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:19.547402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:19.550181 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:19.559646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6ce8bf62-db75-4a4f-b39b-c45d3f7f3641 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.204337 Aug 24 14:36:19.560250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 113/200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:19 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:19.704080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:19.713419 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8072ed8b-8b7b-4700-9db8-7cae98df4969 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.182920 Aug 24 14:36:19.714042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 88/201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:19 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:20.330735 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:20.331244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:20.338889 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.339371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.339797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.340548 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.340993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.341410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.494063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:20.503113 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-759a0c38-a8f5-477e-a567-fd9dc4cc3510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.176171 Aug 24 14:36:20.503718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 114/202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:20 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:20.580987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:20.581549 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:20.588570 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.589051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.589488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.590206 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.590655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.591074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.744389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:20.748933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:20.749695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:20.754527 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-217459cc-ce51-45aa-991f-55ca22f9c4a5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.177351 Aug 24 14:36:20.755174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 89/203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:20 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:20.757769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.758279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.758721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.759710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:20.760168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:20.760648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:20.906329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:20.915399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e061149d-14a7-4c8a-bed0-31fd43c3e03a tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.170725 Aug 24 14:36:20.915992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 115/204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:20 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:21.526903 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:21.527554 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:21.533792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.534321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.534759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.535467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.535925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.536359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.685036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:21.693205 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6a6a0e4c-8ac9-437c-92df-32c7462683b4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.171441 Aug 24 14:36:21.694429 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 90/205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:21 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:21.789828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:21.790743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:21.801269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.801763 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.802353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.803485 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.804081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.804501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.939247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:21.939901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:21.947478 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.947983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.948413 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.949125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:21.953101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:21.953101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:21.982673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:21.993301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0c0338e5-b7c9-4c93-bbee-4852afae7ae8 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.212207 Aug 24 14:36:21.994095 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 116/206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:21 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:22.122608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:22.134668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3a439917-dafd-440c-b780-675a6077ed5b tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.199239 Aug 24 14:36:22.135239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 91/207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:21 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:22.716789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:22.717308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:22.723837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:22.724328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:22.724822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:22.725535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:22.726013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:22.726438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:22.877960 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:22.889377 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b6f0dc3a-df1f-46f7-bdae-3b6d4ed72df9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.176543 Aug 24 14:36:22.890385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 117/208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:22 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:23.023614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:23.024424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:23.031320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.031860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.032330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:23.033142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.033640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.034175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:23.161719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:23.163327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:23.173110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.173979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.174620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:23.175462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.175955 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.176458 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:23.196012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:23.209318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7c22da65-e6b6-4c7a-96d6-a06fd8fcbb2f tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.190562 Aug 24 14:36:23.210452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 92/209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:23 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:23.328653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:23.338255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1d355e7d-f601-48ab-a410-60c62fe79587 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.182601 Aug 24 14:36:23.338854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 118/210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:23 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:23.911715 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:23.912851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:23.919713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.920210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.920645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:23.921374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:23.921858 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:23.922328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:24.075958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:24.085957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-85b0d53d-aefa-4aaa-b9e7-28221afe2f40 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.176967 Aug 24 14:36:24.086609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 93/211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:23 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:24.241733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:24.243239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:24.250249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:24.250738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:24.251170 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:24.251876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:24.252325 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:24.252744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:24.364313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:24.367641 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:24.379918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:24.381016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:24.383490 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:24.385219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:24.386181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:24.387018 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:24.409374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:24.419182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-29a1a98c-cab3-4452-b38b-b119782adddd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.182438 Aug 24 14:36:24.420646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 119/212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:24 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:24.571188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:24.573624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.581077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0393fe8c-e491-42fa-83a8-8108665d4a01 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.224215 Aug 24 14:36:24.582135 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 94/213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:24 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:25.121683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:25.122330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:25.129042 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.129532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.129976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.130782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.131325 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.131846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.136706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.289108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:25.297885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-732c083f-4daa-440f-8a0d-606b1dbca771 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.180157 Aug 24 14:36:25.298910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 120/214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:25 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:25.448072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:25.449332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:25.466324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.467353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.468428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.470267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.471226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.472116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.531578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27d2351-dcbf-4015-a512-f81677b27a58", "name": "network-vif-unplugged", "status": "completed", "tag": "948fcd1f-2483-4103-8b1a-57ec06831af6"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:25.560375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.561424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.567342 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.592052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] Creating event network-vif-unplugged:948fcd1f-2483-4103-8b1a-57ec06831af6 for instance f27d2351-dcbf-4015-a512-f81677b27a58 on hv-cinder-75670 Aug 24 14:36:25.603591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-9ff2c55f-b819-4afa-9117-6dd75ca15549 req-b57beb95-95af-4160-8a51-1d7a5af36db8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081614 Aug 24 14:36:25.604686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 121/215] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:36:25.616908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:25.618932 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:25.630616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.632419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.633212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.634936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:25.635698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:25.636464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:25.880508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:25.898802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ec0ff0d8-0c62-4a6a-aa48-7ac9dd71d242 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1553 microversion: 2.1 time: 0.291280 Aug 24 14:36:25.900291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 122/216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:25 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:26.022793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:26.039848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-490e4bf9-4971-48bb-8061-9df474bcd866 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.601659 Aug 24 14:36:26.041781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 95/217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:25 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:26.330341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:26.330964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:26.338701 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:26.339188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:26.339622 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:26.340329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:26.340783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:26.341394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:26.520914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:26.530731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4a158441-b8dc-4eaa-8963-4dcaa5b2d49c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.204842 Aug 24 14:36:26.531336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 123/218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:26 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:26.925113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:26.927086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:26.940378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:26.941273 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:26.942164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:26.943142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:26.946939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:26.948292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.025279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27d2351-dcbf-4015-a512-f81677b27a58", "name": "network-vif-deleted", "tag": "948fcd1f-2483-4103-8b1a-57ec06831af6"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:27.048733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:27.048733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:27.048733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.066133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:27.079659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3dc3b02a-8d6b-4e23-9dcb-f910820d14bb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1511 microversion: 2.1 time: 0.161417 Aug 24 14:36:27.083240 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 96/219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:26 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:27.083428 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] Creating event network-vif-deleted:948fcd1f-2483-4103-8b1a-57ec06831af6 for instance f27d2351-dcbf-4015-a512-f81677b27a58 on hv-cinder-75670 Aug 24 14:36:27.090442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:27.090706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-74220aea-d7b6-4d7a-b875-a5410ce7476f req-57517660-7465-4ad0-8e9d-e6b7aa77adae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076325 Aug 24 14:36:27.093081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:27.094607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 124/220] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:36:27.109627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:27.113245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:27.114516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.116581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:27.117739 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:27.118899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.568028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:27.578153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:27.582629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:27.596399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5182d8d6-eff4-4fae-ae82-f5c9d115225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.513466 Aug 24 14:36:27.596938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:27.597753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 97/221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:27 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:27.598219 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:27.598845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.600298 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:27.601230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:27.601842 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:27.916615 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:27.939596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-934c96d2-9930-4789-8877-f245187a2dbc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.379374 Aug 24 14:36:27.940454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 125/222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:27 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:28.129669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:28.131657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:28.144872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.146058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.146583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.147954 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.148769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.149269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.212430 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.213020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.213727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.214327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lazy-loading 'fault' on Instance uuid f27d2351-dcbf-4015-a512-f81677b27a58 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:36:28.292978 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e84d3ad291644b84b204b0b3102a095a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1041161b38e4ee0b0b4d7d1f6b3994c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:28.303087 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-10cc6a00-f026-45f1-a230-0ec53c571841 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 200 len: 1351 microversion: 2.1 time: 0.180868 Aug 24 14:36:28.304005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 98/223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:28 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 1351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:28.639024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:28.640133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:28.651819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.652808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.653655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.655117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.656068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.656937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.939017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:28.954490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-790ae7d0-84b5-4cc9-b781-f104ba57410a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.325361 Aug 24 14:36:28.955623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 126/224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:28 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:28.982291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:28.983480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:28.995555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.996454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:28.997254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:28.998529 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:28.999342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.000402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.208812 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:29.219766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-08b38874-ca40-474b-b56e-a0279146e277 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.246557 Aug 24 14:36:29.220572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 99/225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:28 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:29.326474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:29.327563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:29.334734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.335344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.335928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.336793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.337311 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.337795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.353729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] HTTP exception thrown: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Request method failure captured: Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 HTTP/1.1 Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjccequg5XWD9E8neu1I2-JlGT7_Ygz-sIF-ExhzkPQAcSan1J5PXFjK8nvSTcnmaI6Za_wnPuEkJlK02tOOVYC1pqDZLU8vQk3JTUFAl43U4z6e5gGz3PmkCfgS3cZaYL7bDcobDCOEocwGArOEd14D2JH3m_tb4LVn27hll60-Yqw Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:36:29.359398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e1041161b38e4ee0b0b4d7d1f6b3994c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: e84d3ad291644b84b204b0b3102a095a Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.360792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'f27d2351-dcbf-4015-a512-f81677b27a58'} Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:36:29.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.363302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.364427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Returning 404 to user: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:36:29.364427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-40d8e771-809c-4fc5-9bdb-f5ed1c019a64 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 404 len: 111 microversion: 2.1 time: 0.040216 Aug 24 14:36:29.364427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 127/226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:29 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:36:29.501067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:29.504047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:29.511221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.516897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.516897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.516897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.516897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.517579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.530730 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] HTTP exception thrown: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Request method failure captured: Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58/os-volume_attachments HTTP/1.1 Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjccequg5XWD9E8neu1I2-JlGT7_Ygz-sIF-ExhzkPQAcSan1J5PXFjK8nvSTcnmaI6Za_wnPuEkJlK02tOOVYC1pqDZLU8vQk3JTUFAl43U4z6e5gGz3PmkCfgS3cZaYL7bDcobDCOEocwGArOEd14D2JH3m_tb4LVn27hll60-Yqw Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:36:29.535726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e1041161b38e4ee0b0b4d7d1f6b3994c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: e84d3ad291644b84b204b0b3102a095a Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.539034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'server_id': 'f27d2351-dcbf-4015-a512-f81677b27a58'} Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:36:29.541217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:29.546184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:29.547679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Returning 404 to user: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:36:29.547679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4b30504b-17d3-4b45-9db0-275ee39ac37f tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041576 Aug 24 14:36:29.547679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 100/227] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:36:29 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:36:29.862133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbaec5f-8289-44c1-b13d-aa8a3410662a", "name": "network-vif-plugged", "status": "completed", "tag": "5057c58c-fca2-47a0-aca2-10e64cf1195f"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:29.881906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.882875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.883674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.904672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] Creating event network-vif-plugged:5057c58c-fca2-47a0-aca2-10e64cf1195f for instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a on hv-cinder-75670 Aug 24 14:36:29.913572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-ea806fa0-feeb-403a-94d7-4042972ff4e1 req-2b2dfa37-acc2-45c4-a624-3bc55f4830f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059701 Aug 24 14:36:29.914663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 128/228] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:29.981480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:29.982291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:29.990310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.991616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.992223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:29.993188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:29.993810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:29.994354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:30.213468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:30.222772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-51d215ed-1a2f-4e18-bbe9-c94e1a6eb933 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.245525 Aug 24 14:36:30.235508 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 101/229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:29 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:30.244098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:30.246686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:30.253421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:30.253973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:30.254508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:30.255355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:30.256018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:30.256673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:30.434327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:30.448353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-13934328-8601-4d95-909a-72ca6c1702dc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.210114 Aug 24 14:36:30.458050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 129/230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:30 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:31.164892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:31.165573 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:31.174471 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.183867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.183867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.183867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.183867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.184473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.199722 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] HTTP exception thrown: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Request method failure captured: Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 HTTP/1.1 Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjccequg5XWD9E8neu1I2-JlGT7_Ygz-sIF-ExhzkPQAcSan1J5PXFjK8nvSTcnmaI6Za_wnPuEkJlK02tOOVYC1pqDZLU8vQk3JTUFAl43U4z6e5gGz3PmkCfgS3cZaYL7bDcobDCOEocwGArOEd14D2JH3m_tb4LVn27hll60-Yqw Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:36:31.201974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e1041161b38e4ee0b0b4d7d1f6b3994c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: e84d3ad291644b84b204b0b3102a095a Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.203647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'f27d2351-dcbf-4015-a512-f81677b27a58'} Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:36:31.204497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.205785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.207437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Returning 404 to user: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:36:31.207437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-01360af8-0a6d-4e46-9871-fbb55f685fcb tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 404 len: 111 microversion: 2.1 time: 0.045308 Aug 24 14:36:31.207673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 102/231] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:36:31 2022] DELETE /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:36:31.220061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:31.222341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] [instance: f27d2351-dcbf-4015-a512-f81677b27a58] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:31.249424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.252208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:31.253603 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:31.259356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.264564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.265171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.265781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.266320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.267710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.267903 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.268486 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.268624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.269272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.269407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.298988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] HTTP exception thrown: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Request method failure captured: Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 HTTP/1.1 Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjccequg5XWD9E8neu1I2-JlGT7_Ygz-sIF-ExhzkPQAcSan1J5PXFjK8nvSTcnmaI6Za_wnPuEkJlK02tOOVYC1pqDZLU8vQk3JTUFAl43U4z6e5gGz3PmkCfgS3cZaYL7bDcobDCOEocwGArOEd14D2JH3m_tb4LVn27hll60-Yqw Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:36:31.303101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e1041161b38e4ee0b0b4d7d1f6b3994c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e1041161b38e4ee0b0b4d7d1f6b3994c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: e1041161b38e4ee0b0b4d7d1f6b3994c Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-DeleteServersTestJSON-621678368 Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: e84d3ad291644b84b204b0b3102a095a Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-DeleteServersTestJSON-621678368-project Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.304390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'f27d2351-dcbf-4015-a512-f81677b27a58'} Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:36:31.305583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. Aug 24 14:36:31.306680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:31.309561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] Returning 404 to user: Instance f27d2351-dcbf-4015-a512-f81677b27a58 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:36:31.309561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-db2e6b6a-29f4-4845-b33d-205012b5ddb6 tempest-DeleteServersTestJSON-621678368 tempest-DeleteServersTestJSON-621678368-project] 10.222.0.49 "GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58" status: 404 len: 111 microversion: 2.1 time: 0.094522 Aug 24 14:36:31.309561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 130/232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:31 2022] GET /compute/v2.1/servers/f27d2351-dcbf-4015-a512-f81677b27a58 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:36:31.473359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:31.474046 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:31.485231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.486045 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.486594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.487690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:31.488836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:31.489398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:31.677415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:31.689470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ad575532-5161-4645-aae6-551a00d376c2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.444347 Aug 24 14:36:31.690061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 103/233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:31 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:31.743132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:31.758601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-64503bf6-6851-4e0c-8755-39b5a0414510 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.290013 Aug 24 14:36:31.761137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 131/234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:31 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:32.717213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:32.719416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:32.746538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:32.749472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:32.749472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:32.752962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:32.754096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:32.755095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:32.786156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:32.795550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:32.803864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:32.804810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:32.805476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:32.806690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:32.807389 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:32.808034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:33.070779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:33.086301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-72e6e02d-fb27-4ce4-aafc-bc248cced4b7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1312 microversion: 2.1 time: 0.377470 Aug 24 14:36:33.090081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 104/235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:32 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:33.728246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:33.751919 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c85134ce-1c5c-4fac-b055-378f8d9531de tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.970958 Aug 24 14:36:33.754044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 132/236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:32 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:34.126106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:34.127424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:34.144868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:34.145432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:34.145896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:34.148584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:34.149330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:34.149932 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:34.779755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:34.780367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:34.805300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:34.805534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:34.808694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:34.809505 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:34.812576 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:34.814198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:34.815526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:34.827355 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6df44e20-bbe9-46b3-9e48-66fb9fc780f9 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1496 microversion: 2.1 time: 0.702783 Aug 24 14:36:34.830264 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 105/237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:34 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1496 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:35.372254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:35.382346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4caa2971-e58f-45fd-820c-879e139c7ab1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1519 microversion: 2.1 time: 0.607467 Aug 24 14:36:35.395495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 133/238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:34 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1519 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:36.404837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:36.405461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:36.409192 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:36.413239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.413741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.414214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.418859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.419606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.420445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.446033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:36.446725 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:36.458229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.458749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.459799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.460467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.461055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.461519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.521537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:36:36.828652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:36.874238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3bdfbbdc-e070-41df-90fe-e83cff066c02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1499 microversion: 2.1 time: 0.457538 Aug 24 14:36:36.874238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 106/239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:36 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1499 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:36.900771 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:36.902464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:36.915401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.916592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.917633 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.919729 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:36.920617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:36.931688 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:36.985362 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-999647f1-7280-47f7-9ae0-453036590c5e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 204 len: 0 microversion: 2.1 time: 0.545383 Aug 24 14:36:36.986309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 134/240] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:36:36 2022] DELETE /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:36.997882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:36.998741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:37.042474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:37.043639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:37.047492 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:37.049103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:37.051375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:37.053381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:37.355324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:37.371175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dfdbf940-2459-4ef9-89b9-f9e45005daac tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1515 microversion: 2.1 time: 0.478165 Aug 24 14:36:37.372743 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 107/241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:36 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:37.789584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:37.800720 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9c05cb81-9f49-4b80-98ce-952e08f5cbda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1502 microversion: 2.1 time: 0.807437 Aug 24 14:36:37.801773 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 135/242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:36 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1502 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:38.827833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:38.829723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:38.847951 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:38.849032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:38.850709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:38.852220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:38.853326 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:38.854395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:39.464581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:39.480971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6bdc845d-5f77-4b2c-9322-f82596699f3b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1502 microversion: 2.1 time: 0.659501 Aug 24 14:36:39.490302 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 108/243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:38 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1502 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:39.854718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:39.859724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:39.868123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:39.869397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:39.870135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:39.871126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:39.871830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:39.872471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:39.912048 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'flavor' on Instance uuid 945183a7-1a55-4233-af05-abb55ac82c9b {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:36:40.010429 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbaec5f-8289-44c1-b13d-aa8a3410662a", "name": "network-vif-deleted", "tag": "5057c58c-fca2-47a0-aca2-10e64cf1195f"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:40.043170 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.043697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.044142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.073107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] Creating event network-vif-deleted:5057c58c-fca2-47a0-aca2-10e64cf1195f for instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a on hv-cinder-75670 Aug 24 14:36:40.086020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-1cb946aa-8494-443a-9bc3-32b7fac9728c req-f8e4a830-6490-464d-b98f-921c4fb40b5d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096480 Aug 24 14:36:40.088195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 109/244] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:40.119386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.439638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f8ddb1cc-2d78-4a97-8794-e9965658ee0c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/action" status: 200 len: 32 microversion: 2.1 time: 0.581622 Aug 24 14:36:40.439638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 136/245] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:36:39 2022] POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/action => generated 32 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:36:40.448183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:40.449225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:40.460646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.461843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.462624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.463649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.464371 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.465701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.522348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:40.524323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:40.555980 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.556764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.557555 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.561667 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.562453 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.563173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.678907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:40.689867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:40.693077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:40.705383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lazy-loading 'fault' on Instance uuid 3bbaec5f-8289-44c1-b13d-aa8a3410662a {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:36:40.797661 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:40.820468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b4ecf1dd-de69-40a5-890f-6ff590904f2e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.377106 Aug 24 14:36:40.820468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 110/246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:40 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:40.948083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:40.956712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f863d70a-de86-4f86-9ac3-1fbacb6eb6bd tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 200 len: 1302 microversion: 2.1 time: 0.446569 Aug 24 14:36:40.962626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 137/247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:40 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 1302 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:41.851070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:41.865116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:41.888974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:41.913449 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:41.915420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:41.915814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:41.916601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:41.917409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:42.013820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:42.014606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 3bbaec5f-8289-44c1-b13d-aa8a3410662a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:42.057331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:42.058276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:42.058962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:42.065930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:42.067350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:42.067802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:42.089966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] HTTP exception thrown: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Request method failure captured: Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a HTTP/1.1 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjdQLSuQgSEv_KxDWPaFSPJIZoVos5LcizhqyZvAYEpTLG6A2dyHzfy-baBIRRzB0JYWcMP3kxvQdOiiUqAXbHtnAB-YdOD8NXnUSphf8iCmgIbgYEApiFQA3J98qCc70YFn5ctyiG9TyWeXWH7BmMJn-8941Icp1xGnPF8Rwxott68 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: aa7908a26d224db1bf2e074c5f25b315 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesActionsTest-335390917 Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:36:42.095519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa7908a26d224db1bf2e074c5f25b315", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesActionsTest-335390917 Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: aa7908a26d224db1bf2e074c5f25b315 Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesActionsTest-335390917 Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesActionsTest-335390917-project Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 6e729065f1524fd9bf9ef3c6b42f7a5e Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesActionsTest-335390917-project Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. Aug 24 14:36:42.096847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '3bbaec5f-8289-44c1-b13d-aa8a3410662a'} Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:36:42.097626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. Aug 24 14:36:42.098783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:36:42.102092 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Returning 404 to user: Instance 3bbaec5f-8289-44c1-b13d-aa8a3410662a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:36:42.103235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e5c5595c-a73f-4835-978e-55cc501536c7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a" status: 404 len: 111 microversion: 2.1 time: 0.102196 Aug 24 14:36:42.104639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 138/248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:41 2022] GET /compute/v2.1/servers/3bbaec5f-8289-44c1-b13d-aa8a3410662a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:36:42.500813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-398147995", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "networks": [{"uuid": "bef4335d-6a3c-4811-b510-01e33217e631"}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:42.609357 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:42.630041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fadc4da6-8c0a-48c9-9bba-33c4d9c35f74 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.783601 Aug 24 14:36:42.638769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 111/249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:41 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:42.674588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] validate_networks() for [('bef4335d-6a3c-4811-b510-01e33217e631', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:36:43.352252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:36:43.353466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:36:43.353466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:36:43.353772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:36:43.354172 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:36:43.382195 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:43.383089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:43.384334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:43.385305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:43.386267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:43.387093 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:43.418914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Getting quotas for project aa7908a26d224db1bf2e074c5f25b315. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:36:43.426583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Getting quotas for user 6e729065f1524fd9bf9ef3c6b42f7a5e and project aa7908a26d224db1bf2e074c5f25b315. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:36:43.466770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:36:43.469212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:36:43.669892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:43.670701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:43.677506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:43.678659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:43.679103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:43.680038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:43.680503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:43.680926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:43.726801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cf608689-c1d2-43a3-9b5e-e63c94b749ad tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230549 Aug 24 14:36:43.727470 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 139/250] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:36:43.747915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-059a7c4b-0c27-4c27-b34d-cb8807d325c5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:43.748698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-059a7c4b-0c27-4c27-b34d-cb8807d325c5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:43.833010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-059a7c4b-0c27-4c27-b34d-cb8807d325c5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:43.845025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-059a7c4b-0c27-4c27-b34d-cb8807d325c5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1213 microversion: 2.1 time: 0.099336 Aug 24 14:36:43.845025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 140/251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:43 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:44.024854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:44.055553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a7e4d5fa-5bb7-4184-9181-bebb6b50e78f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.379537 Aug 24 14:36:44.056401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 112/252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:43 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:44.880382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-39c92fd1-c753-4f10-a4ed-e6036bdab7cb tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:44.891683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-39c92fd1-c753-4f10-a4ed-e6036bdab7cb tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:44.977611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-39c92fd1-c753-4f10-a4ed-e6036bdab7cb tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:44.995494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-39c92fd1-c753-4f10-a4ed-e6036bdab7cb tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1213 microversion: 2.1 time: 0.122736 Aug 24 14:36:44.996614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 141/253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:44 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:45.096553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:45.097832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:45.124443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:45.125843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:45.125843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:45.128651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:45.129215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:45.129676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:45.138056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.553119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:45.565839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bb1e3aea-6eae-4513-8f79-8db6bf129dc4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.484858 Aug 24 14:36:45.567405 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 113/254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:45 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:46.057159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:46.059164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:46.070982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:46.073930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:46.074884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:46.076394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:46.078096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:46.079197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:46.080802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:46.236282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:46.269891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-16958879-6c97-4657-839d-de1ce510225d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1209 microversion: 2.1 time: 0.236729 Aug 24 14:36:46.273515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 142/255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:46 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1209 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:46.593035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:46.593817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:46.604885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:46.605402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:46.605837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:46.612092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:46.612610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:46.613065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:46.956026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:46.965347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b59eae2e-c13a-48a9-86ad-bb24ff59bbaf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.378910 Aug 24 14:36:46.966394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 114/256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:46 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:47.302161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:47.307702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:47.331260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:47.332081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:47.332886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:47.333786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:47.336076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:47.336562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:47.502674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:47.512039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4e7c5fcb-5f48-479b-8657-6d3db5b878a2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1273 microversion: 2.1 time: 0.222024 Aug 24 14:36:47.519378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 143/257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:47 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:47.999401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:48.000195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:48.010370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:48.011378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:48.012001 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:48.012849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:48.013426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:48.014361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:48.560470 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:48.570682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:48.571645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:48.598692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:48.603058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:48.616256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:48.616256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:48.616974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6f6b4cc7-ca8e-45e1-ad67-eed540117633 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.608931 Aug 24 14:36:48.617156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:48.617156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:48.617415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 115/258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:47 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:48.770157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:48.797869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5e49d249-cd4a-4407-90c1-c4e84aaa58e4 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1271 microversion: 2.1 time: 0.258217 Aug 24 14:36:48.799370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 144/259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:48 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:49.642373 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:49.643680 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:49.657324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:49.658742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:49.659925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:49.661385 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:49.665897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:49.666733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:49.833940 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:49.834648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:49.842795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:49.849109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:49.849846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:49.850720 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:49.851369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:49.854433 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:50.018705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:50.040841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c29e0da3-23b2-4b35-ad71-97ff90e532a6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.413009 Aug 24 14:36:50.042610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 116/260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:49 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:50.149160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:50.150065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:50.170036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:50.176358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:50.178672 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:50.179397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:50.180183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:50.180669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:50.181110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:50.191372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d13bd2ba-a952-48d0-9595-fadd0ea4233e tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.361320 Aug 24 14:36:50.207502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 145/261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:49 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:50.240312 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fe89826e-7624-49f9-a32c-8241ce32b749 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/ips" status: 200 len: 149 microversion: 2.1 time: 0.099939 Aug 24 14:36:50.242423 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 117/262] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:36:50 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/ips => generated 149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:51.069599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:51.071946 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:51.083754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:51.086135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:51.087353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:51.089111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:51.090368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:51.091519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:51.234317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:51.235005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:51.243886 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:51.244754 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:51.245379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:51.246186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:51.246784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:51.247072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:51.439629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:51.457859 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a8710da4-720a-4683-ac1f-3eea39e7e8d6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.396995 Aug 24 14:36:51.478751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 146/263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:51 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:51.478751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30625324-a0fa-417e-9076-c78df393b6cb", "tag": "6f9de490-42a0-4575-bba2-0626ad5ba361"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:51.492235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:51.492235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:51.492235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:51.532416 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] Creating event network-changed:6f9de490-42a0-4575-bba2-0626ad5ba361 for instance 30625324-a0fa-417e-9076-c78df393b6cb on hv-cinder-75670 Aug 24 14:36:51.543607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-eff124a8-d6ae-4e95-b9a3-0414239c866b req-9c08ac4b-3efa-412a-8250-bcf5b712e18b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083612 Aug 24 14:36:51.546148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 147/264] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:51.815791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:51.856625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8ead18eb-307c-49a5-a2be-bde99b916983 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.623230 Aug 24 14:36:51.861232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 118/265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:51 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:52.491456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:52.493802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:52.512498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:52.514581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:52.523875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:52.523875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:52.523875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:52.523875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:52.795234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:52.862420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ff5f14ba-bc73-40c6-bde2-2d111ce93095 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.357208 Aug 24 14:36:52.862420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 148/266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:52 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:52.898292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:52.901215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:52.943023 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:52.948582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:52.953134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:52.964659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:52.968975 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:52.973445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:53.035559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e144cc-7b97-42a7-9f6a-285140ee11cf"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:53.040316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:53.071132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:53.071644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:53.072255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:53.073230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:53.073529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:53.073966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:53.401716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:53.421357 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:53.443652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8ff5ad44-d65f-4727-a1a2-ca0c7a030b73 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.554182 Aug 24 14:36:53.447567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 119/267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:52 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:53.869890 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:53.871717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:53.883437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:53.886235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:53.887054 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:53.888096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:53.892103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:53.892720 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:54.182171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:54.195826 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f03a757b-c0a7-46d6-a2ce-83a57eef9a93 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.330652 Aug 24 14:36:54.196437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 120/268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:53 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:54.480486 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:54.485276 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:54.497030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:54.498492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:54.499550 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:54.501619 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:54.502844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:54.504072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:54.641927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-af121330-693b-4315-bdf6-a857aada7307 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.613839 Aug 24 14:36:54.645407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 149/269] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:36:53 2022] POST /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 194 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:54.846774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:54.851949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:54.904115 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:54.909595 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:54.913459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:54.914556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:54.918807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:54.919262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:54.924723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:54.973160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-113a9005-4f4b-4426-b2c0-a5651afbfda5 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.503137 Aug 24 14:36:54.984347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 121/270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:54 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:54.985662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-15b2bbcd-3439-4ab8-967f-f138589fd670 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/ips" status: 200 len: 145 microversion: 2.1 time: 0.154151 Aug 24 14:36:54.994270 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:55.002237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 150/271] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:36:54 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/ips => generated 145 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:55.012805 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:55.027683 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:55.028915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:55.033470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:55.042563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:55.044236 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:55.046981 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:55.115464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d7ab2fe8-370f-4cff-8029-4718d9e4002f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.134757 Aug 24 14:36:55.118131 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 122/272] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 24 14:36:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/ips => generated 151 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:55.220391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:55.222259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:55.227671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=10 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.236691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:55.238385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:55.238790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:55.243689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:55.243689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:55.243689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:55.512275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:55.523304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ca4193ca-2a9f-4794-b874-f43d2bd767fd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.308602 Aug 24 14:36:55.542157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 151/273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:55 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:56.008728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:56.010790 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:56.030138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:56.031799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:56.034943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:56.040821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:56.047495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:56.053917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:56.339416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:56.361323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-29640da5-db16-4a3a-bf29-d21a434e581b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.361586 Aug 24 14:36:56.367533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 123/274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:55 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:56.551434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:56.555371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:56.579874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:56.580768 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:56.590541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:56.591926 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:56.592987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:56.594049 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:57.077427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:57.098840 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-19e8afdd-4500-4390-a885-850c292a04e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.554768 Aug 24 14:36:57.102981 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 152/275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:56 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:57.433739 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:57.434990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:57.457787 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:57.460783 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:57.465232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:57.466910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:57.468474 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:57.469593 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:58.132948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:58.138308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:58.141813 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:58.146905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:58.148061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:58.149017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:58.150070 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:58.150638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:58.151799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:58.176064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-45c2e29a-a549-42cc-a0e9-3b1a1e088f7b tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.749291 Aug 24 14:36:58.177758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 124/276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:57 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:58.562062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:58.593268 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cddc550d-9e0f-4af0-a151-0909e1dbbc19 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.470796 Aug 24 14:36:58.599618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 153/277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:58 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:58.981283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30625324-a0fa-417e-9076-c78df393b6cb", "name": "network-vif-plugged", "status": "completed", "tag": "6f9de490-42a0-4575-bba2-0626ad5ba361"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:58.981283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:58.981283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:58.981283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.066051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] Creating event network-vif-plugged:6f9de490-42a0-4575-bba2-0626ad5ba361 for instance 30625324-a0fa-417e-9076-c78df393b6cb on hv-cinder-75670 Aug 24 14:36:59.089869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-01f0e106-e7d0-4e28-825b-67a1fb6b4041 req-d718d0dc-35b2-4dd4-9c94-f60287b26102 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154289 Aug 24 14:36:59.091291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 125/278] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:59.137072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:36:59.138079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:59.184945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.184945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.184945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.187118 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.191115 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.192255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.232515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lazy-loading 'flavor' on Instance uuid 3df69832-0c15-4371-b4cd-a5517f6945b3 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:36:59.235999 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:59.237378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:59.250766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.251996 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.252989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.254526 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.256255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.257544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.546617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:59.555794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e3116a5b-75c9-45bc-8773-f494ff5fdfaf tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.339739 Aug 24 14:36:59.577436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 126/279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:59 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:59.581071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:59.619927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:59.620634 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:36:59.647422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.647950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.648401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.658681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:59.661770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:59.664093 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:59.967054 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:36:59.987272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f2fb85fe-5f3b-40f7-8358-309f53841441 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.369021 Aug 24 14:36:59.987969 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 127/280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:36:59 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:00.369329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-293392a7-7c7e-4c90-9eb7-509edea176ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/action" status: 202 len: 0 microversion: 2.20 time: 1.262025 Aug 24 14:37:00.376490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 154/281] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 14:36:59 2022] POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/action => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:37:00.387436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:00.391872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:00.417726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.418884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.420614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.421605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.422273 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.422861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.585619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:00.586674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:00.605985 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.607279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.607917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.609097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.609821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.610676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.695665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:00.707401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:00.710394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:00.711990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c5591f2e-b988-4717-9f05-5d35ddbb7618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.333892 Aug 24 14:37:00.713358 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 128/282] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:00 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:00.875915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7780f14-a37f-4658-a742-8b0762d0a54d"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:00.880159 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:00.908007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:00.910447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.911141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.913035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.913928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:00.916010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:00.917783 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:00.917914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5a713a05-fceb-4acf-b08c-641559b3421a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1313 microversion: 2.1 time: 0.337603 Aug 24 14:37:00.931256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 155/283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:00 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:01.025150 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:01.026162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:01.034487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.035271 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.035885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.036837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.037467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.038149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.268963 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:01.279177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0c9ca88b-7791-40a2-9c9b-fc0452061bdb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1501 microversion: 2.1 time: 0.263912 Aug 24 14:37:01.279792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 156/284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:01 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:01.303631 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14235eeb-0547-42ee-96b4-93274e99c17f"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:01.306315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:01.314015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.314530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.315036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.315776 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.316293 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.316724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.367368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] HTTP exception thrown: Cannot 'attach_volume' instance 945183a7-1a55-4233-af05-abb55ac82c9b while it is in vm_state rescued Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Request method failure captured: Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/os-volume_attachments HTTP/1.1 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 74 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcQU4fU91ml_MReRF7S67gknM-h3d06v2-hyoznVH7NxKdVNgWsUroE1sdodqWiiuMg2R1WK87YUsBH30QzQiI93XSWGQ2aIk3c1iKdd09teSLTav9AQTntxqITLXHxhRMLWxpswlZFaAH5bxfdHpfKKqGqFTBK15wdWle_iFWmOZY Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:37:01.369148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7af0efe201074713a9076e220de8ea61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7af0efe201074713a9076e220de8ea61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 3570472f8c2b42b480ec1d1220414bec Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {"volumeAttachment": {"volumeId": "14235eeb-0547-42ee-96b4-93274e99c17f"}} Aug 24 14:37:01.371013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Cannot 'attach_volume' instance 945183a7-1a55-4233-af05-abb55ac82c9b while it is in vm_state rescued Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'server_id': '945183a7-1a55-4233-af05-abb55ac82c9b', 'body': {'volumeAttachment': {'volumeId': '14235eeb-0547-42ee-96b4-93274e99c17f'}}} Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 945183a7-1a55-4233-af05-abb55ac82c9b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:37:01.371877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 945183a7-1a55-4233-af05-abb55ac82c9b while it is in vm_state rescued Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:01.373174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 945183a7-1a55-4233-af05-abb55ac82c9b while it is in vm_state rescued Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Returning 409 to user: Cannot 'attach_volume' instance 945183a7-1a55-4233-af05-abb55ac82c9b while it is in vm_state rescued {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:37:01.374404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7b0d00fe-42c9-44e5-a50d-7990bcf7068a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072048 Aug 24 14:37:01.383019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 157/285] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:37:01 2022] POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 14:37:01.396830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:01.401132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:01.420866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.421805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.422748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.423979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.424630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.425224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.725654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f3704c32-9e4e-40e5-9597-fcc36c8df641 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/action" status: 202 len: 0 microversion: 2.1 time: 0.340808 Aug 24 14:37:01.726309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 158/286] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:37:01 2022] POST /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:37:01.741355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:01.741797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:01.752666 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.753485 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.754163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:01.755210 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:01.756468 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:01.757147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:02.011411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:02.035698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cc07b212-8f4d-4955-a733-ebf3bc77f635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1509 microversion: 2.1 time: 0.302609 Aug 24 14:37:02.036886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 159/287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:01 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:02.071398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:02.073843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:02.094738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:02.095279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:02.096530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:02.097872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:02.098538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:02.099125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:02.519962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:02.531451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:02.533567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:02.535064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6022529f-6502-4d76-af78-eeca13f8e3c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.468252 Aug 24 14:37:02.552119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 160/288] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:02 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:02.552119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:02.552119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:02.569480 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:02.570967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:02.572398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:02.573610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:02.574510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:02.575229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:02.829728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:02.841643 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0fdd358f-7fe7-47e3-a987-f37842c32d4a tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1496 microversion: 2.1 time: 0.300756 Aug 24 14:37:02.842512 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 161/289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:02 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1496 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:03.082699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:03.105121 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:03.150533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:03.155875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:03.161365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:03.166937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:03.168297 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:03.169325 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:03.483198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:03.494193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e861b886-58e5-4efc-a937-61df326b6d28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1509 microversion: 2.1 time: 0.423216 Aug 24 14:37:03.510333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 162/290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:03 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1509 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:03.596796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:03.596796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:03.596796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:03.596796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:03.597606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:03.597606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:03.597606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:03.597606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:03.887839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:03.915294 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:03.920651 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:03.923210 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ddf07f42-62a6-4ea9-849a-eee6456565db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.348727 Aug 24 14:37:03.924445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 163/291] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:03 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:04.442338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:04.528307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:04.532161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:04.572091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:04.572910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:04.573638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:04.574856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:04.575625 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:04.582403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:04.585875 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2a0b1693-75a4-4425-be21-05a20740b77e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.712548 Aug 24 14:37:04.591993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 129/292] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:37:00 2022] POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments => generated 194 bytes in 3720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:04.965235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:04.966985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:05.017203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:05.028144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:05.028391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-29e680c0-6d01-40da-9589-3c3455d9f0e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1509 microversion: 2.1 time: 0.510400 Aug 24 14:37:05.030045 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:05.030854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:05.031993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:05.032628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:05.033226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:05.041179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 164/293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:04 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:05.079264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e78709ad-6e8c-4815-9f6b-1cf47aa58a5a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: .version_select at 0x7f8a8c17fee0>, body: {"keypair": {"name": "tempest-keypair-2065514021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8Y/KnuNm7JgQB6IavMFYHf+6t4ld/+Jyn6g3olihjHWbFveOzetUXqsz9N+U8GmUOgMPIg9V7FyQPINfcRw9pqgRx7RophjwIAIFQse2833shSYO80FHdMVv9XEQaBnA=="}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:05.118649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-e78709ad-6e8c-4815-9f6b-1cf47aa58a5a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:05.127498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-e78709ad-6e8c-4815-9f6b-1cf47aa58a5a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:05.278575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e78709ad-6e8c-4815-9f6b-1cf47aa58a5a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233506 Aug 24 14:37:05.280017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 165/294] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:37:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:05.339867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:05.355071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:05.358284 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:05.370158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0ebeafa1-a356-482e-99a9-24ba50696955 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.423076 Aug 24 14:37:05.371415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 130/295] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:04 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:06.082822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:06.083481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:06.099962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.108565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.108565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.108565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.122086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.122623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.131496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:06.137026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:06.176516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.188022 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.191697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.196713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.200894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.205352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.343234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:06.353300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-290d51d3-7a03-44c9-baec-784c02353f26 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1515 microversion: 2.1 time: 0.275990 Aug 24 14:37:06.354636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 166/296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:06 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:06.389629 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:37:06.413091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:06.413744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:06.436058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.436569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.445018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.447427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:06.447934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:06.449488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:06.699339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:06.724563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:06.730542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:06.733749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f4d7ff1a-e3fc-47ee-9fdd-73c33c3cbfbc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.324831 Aug 24 14:37:06.735575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 167/297] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:06 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:07.197923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3e9c2879-63a8-4ed3-9f4e-c99b6f0505d2 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 204 len: 0 microversion: 2.1 time: 1.074412 Aug 24 14:37:07.200675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 131/298] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:37:06 2022] DELETE /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:37:07.211838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:07.213078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:07.227580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:07.229078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:07.230054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:07.231488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:07.232610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:07.234159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:07.573853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:07.592076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6cb8234e-0e64-4175-bc70-ec376598995d tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1502 microversion: 2.1 time: 0.385561 Aug 24 14:37:07.592679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 168/299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:07 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:07.762123 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:07.762955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:07.770387 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:07.770895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:07.772017 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:07.773015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:07.773516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:07.773984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:07.955316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:07.965545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:07.967131 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:07.968338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d1374a54-91af-40f2-b7ed-9018044ee672 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.211725 Aug 24 14:37:07.968922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 132/300] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:07 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:08.669219 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:08.673652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:08.711133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:08.711948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:08.712874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:08.730563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:08.745044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:08.745044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:08.993214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:08.994158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:08.998223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:09.029525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:09.030048 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:09.035485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:09.036283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:09.037031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:09.037648 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:09.249565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:09.265895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1b30d758-1bf0-4b9b-86dc-71ad9b36d134 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1502 microversion: 2.1 time: 0.640685 Aug 24 14:37:09.270745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 169/301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:08 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:09.737859 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:09.777948 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:09.785595 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:09.788093 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7e505447-6303-48d1-b4cd-c7cbefa29c66 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.799282 Aug 24 14:37:09.804740 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 133/302] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:08 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:10.220936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-15ff7313-4a02-42ed-b8a9-66eb241b436b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: .version_select at 0x7f8a8c1f2e50>, body: {"keypair": {"name": "tempest-keypair-1376835741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/La+LdwzuKBa+M/29viTwDi1TSCkGAC6SNqHRngs3BQVBNQdTMSnlCgaKdhiIzC/WPBlQRUaoRj6FqrYyUQCskJBPSY7ftG1kIyzfvOcz2mnvhcYnonLFcC5KDmBrNYg=="}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:10.254350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30625324-a0fa-417e-9076-c78df393b6cb", "name": "network-vif-deleted", "tag": "6f9de490-42a0-4575-bba2-0626ad5ba361"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:10.268895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-15ff7313-4a02-42ed-b8a9-66eb241b436b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for project 7af0efe201074713a9076e220de8ea61. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:10.278486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-15ff7313-4a02-42ed-b8a9-66eb241b436b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for user 3570472f8c2b42b480ec1d1220414bec and project 7af0efe201074713a9076e220de8ea61. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:10.280645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:10.281198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:10.281637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:10.312067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] Creating event network-vif-deleted:6f9de490-42a0-4575-bba2-0626ad5ba361 for instance 30625324-a0fa-417e-9076-c78df393b6cb on hv-cinder-75670 Aug 24 14:37:10.322507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-c1aa81a5-bd16-4281-bf39-babda66bfbeb req-55393c55-807f-412e-bbbd-13d2f7362c87 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070148 Aug 24 14:37:10.329861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 134/303] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:37:10.341342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:10.342374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:10.351489 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:10.352271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:10.352880 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:10.353775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:10.354553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:10.355133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:10.420888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-15ff7313-4a02-42ed-b8a9-66eb241b436b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198894 Aug 24 14:37:10.420888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 170/304] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:37:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:37:10.540227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:10.556715 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9a76b981-e2d9-441f-800f-c358da06aeda tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1460 microversion: 2.1 time: 0.224825 Aug 24 14:37:10.572285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 135/305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:10 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:10.813858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:10.814740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:10.823659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:10.824618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:10.825165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:10.826246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:10.829343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:10.829983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:11.613220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:11.613220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:11.619283 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:11.632195 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.652270 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:11.652843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:11.655431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:11.658400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:11.661002 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:11.661300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:11.661612 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:11.676173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:11.690471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e4193168-c232-4a14-9c79-a036854c4d90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.870359 Aug 24 14:37:11.726832 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 171/306] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:10 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:11.745676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:11.751841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:11.751841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:11.751841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lazy-loading 'fault' on Instance uuid 30625324-a0fa-417e-9076-c78df393b6cb {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:37:11.824069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e729065f1524fd9bf9ef3c6b42f7a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7908a26d224db1bf2e074c5f25b315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:11.837043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b14a8f3a-75f7-4ec7-b39f-1a07c423e3a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 200 len: 1303 microversion: 2.1 time: 0.242499 Aug 24 14:37:11.838703 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 136/307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:11 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:12.514031 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-240625291", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c1b2e1f-70b2-4451-9050-eb07b892f67d"}], "security_groups": [{"name": "tempest-securitygroup--1589502480"}], "key_name": "tempest-keypair-2065514021", "user_data": "}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:12.759291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:12.761711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:12.797167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.797354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] validate_networks() for [('9c1b2e1f-70b2-4451-9050-eb07b892f67d', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:37:12.804228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.805289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:12.807396 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.808619 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.809693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:13.054572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:13.066420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:13.067234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:13.068747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-45b28941-3e4a-4a75-9696-7a0c871feef4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.325837 Aug 24 14:37:13.069579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 137/308] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:12 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:13.074844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:13.075747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] [instance: 30625324-a0fa-417e-9076-c78df393b6cb] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:13.083029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:13.084397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:13.085214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:13.086244 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:13.086934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:13.087732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:13.107215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] HTTP exception thrown: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Request method failure captured: Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb HTTP/1.1 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjdQLSuQgSEv_KxDWPaFSPJIZoVos5LcizhqyZvAYEpTLG6A2dyHzfy-baBIRRzB0JYWcMP3kxvQdOiiUqAXbHtnAB-YdOD8NXnUSphf8iCmgIbgYEApiFQA3J98qCc70YFn5ctyiG9TyWeXWH7BmMJn-8941Icp1xGnPF8Rwxott68 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: aa7908a26d224db1bf2e074c5f25b315 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesActionsTest-335390917 Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:37:13.109081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aa7908a26d224db1bf2e074c5f25b315", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aa7908a26d224db1bf2e074c5f25b315"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesActionsTest-335390917 Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: aa7908a26d224db1bf2e074c5f25b315 Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesActionsTest-335390917 Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesActionsTest-335390917-project Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 6e729065f1524fd9bf9ef3c6b42f7a5e Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesActionsTest-335390917-project Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. Aug 24 14:37:13.112060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '30625324-a0fa-417e-9076-c78df393b6cb'} Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:37:13.113604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. Aug 24 14:37:13.116963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:37:13.118910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] Returning 404 to user: Instance 30625324-a0fa-417e-9076-c78df393b6cb could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:37:13.118910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2f2bd58a-c42a-4a3d-a49d-091513c619a7 tempest-VolumesActionsTest-335390917 tempest-VolumesActionsTest-335390917-project] 10.222.0.49 "GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb" status: 404 len: 111 microversion: 2.1 time: 0.039813 Aug 24 14:37:13.124688 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 138/309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:13 2022] GET /compute/v2.1/servers/30625324-a0fa-417e-9076-c78df393b6cb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:37:13.411636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:37:13.412384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:37:13.413142 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:37:13.413664 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:37:13.414244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:37:13.424474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:13.424993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:13.425433 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:13.426215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:13.426682 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:13.427123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:13.447973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:13.453017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:13.467260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:37:13.469842 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:37:13.688596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a5e1cfd5-2cf9-4b84-bc70-2c9e21ddf68a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.185309 Aug 24 14:37:13.691378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 172/310] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:37:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:37:13.717317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a92afb5c-94f5-4912-ab9b-5a19ce6d5f26 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:13.719007 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a92afb5c-94f5-4912-ab9b-5a19ce6d5f26 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:14.122278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:14.138137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:14.172846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:14.176752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:14.176752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:14.176752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:14.187067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:14.196888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:14.199057 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a92afb5c-94f5-4912-ab9b-5a19ce6d5f26 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:14.232401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a92afb5c-94f5-4912-ab9b-5a19ce6d5f26 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1241 microversion: 2.1 time: 0.521090 Aug 24 14:37:14.233802 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 139/311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:13 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1241 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:14.650888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:14.665001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:14.668542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:14.671679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-13c6cffb-ce50-4038-9cb4-6422fb957abc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.564639 Aug 24 14:37:14.679024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 173/312] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:14 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:15.270622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-87d6dbc1-5a61-4531-a26c-58539305c896 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:15.271962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-87d6dbc1-5a61-4531-a26c-58539305c896 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:15.409876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-87d6dbc1-5a61-4531-a26c-58539305c896 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:15.421403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-87d6dbc1-5a61-4531-a26c-58539305c896 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1241 microversion: 2.1 time: 0.155399 Aug 24 14:37:15.434366 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 140/313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:15 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:15.703600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:15.704390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:15.710211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:15.716564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:15.717163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:15.717707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:15.718621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:15.719203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:15.719716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:15.876544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b4a58878-0cb8-431f-9444-714b50c1310a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'create', calling method: .version_select at 0x7f8a8c22d820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-54865592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrBLqLYESFeUHjCGyjQ8i+1XVGDdBX05FMYAX1L+X0m4Oe6TeC56pzwbYPzUW/Q8MFgGPX+Y/ccOgvx0C8FzsCURpaF1wg9Dh9SeB+kHtIARDnKkI/neNWnuXHE2tOPTQ=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:15.942071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b4a58878-0cb8-431f-9444-714b50c1310a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Getting quotas for project 853f7f0f1616478c9744f93293be553e. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:15.953929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b4a58878-0cb8-431f-9444-714b50c1310a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Getting quotas for user de720e2d8a0f4b5f898e00ce90befd58 and project 853f7f0f1616478c9744f93293be553e. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:16.073216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:16.083279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:16.085877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:16.087547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-aa934a21-64dc-4f21-a332-b851b16c7871 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.389744 Aug 24 14:37:16.088455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 174/314] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:15 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:16.157313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b4a58878-0cb8-431f-9444-714b50c1310a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.285283 Aug 24 14:37:16.168756 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 141/315] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:37:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:16.314994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1836481957", "imageRef": "2c743b2a-166f-4334-ac0a-4c4dc970fd57", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-54865592", "networks": [{"uuid": "ac63a762-a146-40f6-ae28-9ee470672ca7"}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:16.395179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] validate_networks() for [('ac63a762-a146-40f6-ae28-9ee470672ca7', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:37:16.459936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:16.461291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:16.501589 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:16.502861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:16.504059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:16.506447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:16.508583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:16.509970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:16.670692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:16.683861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2ce950e5-a99b-40af-98ea-744b2cfda3f1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1237 microversion: 2.1 time: 0.227990 Aug 24 14:37:16.710262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 142/316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:16 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1237 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:16.779118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:16.787383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:16.788096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:16.788544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:16.863164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Going to try to stop instance {{(pid=127923) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:37:17.058715 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:37:17.059499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:37:17.059778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:37:17.060323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:37:17.060734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:37:17.070605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.071110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.071535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.072265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.072712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.073608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.096706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Getting quotas for project 853f7f0f1616478c9744f93293be553e. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:17.101377 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Getting quotas for user de720e2d8a0f4b5f898e00ce90befd58 and project 853f7f0f1616478c9744f93293be553e. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:17.114493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:37:17.116853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c743b2a-166f-4334-ac0a-4c4dc970fd57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:37:17.255124 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b74659bc-a420-4399-9956-67f60775dab8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action" status: 202 len: 0 microversion: 2.1 time: 0.480413 Aug 24 14:37:17.255771 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 143/317] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:37:16 2022] POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:37:17.262100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1690536024", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d025b1af-d5b6-4d76-9e5f-f5e52ae15180"}], "security_groups": [{"name": "tempest-securitygroup--509272340"}], "key_name": "tempest-keypair-1376835741", "user_data": "}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:17.310401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-abff29d3-e463-452c-9840-e0d7f62b901b tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999002 Aug 24 14:37:17.311334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 175/318] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:37:17.321200 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:17.324147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:17.354447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.354447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.354447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.355705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.356539 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.357311 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.445458 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] validate_networks() for [('d025b1af-d5b6-4d76-9e5f-f5e52ae15180', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:37:17.635091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:17.648547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:17.650244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:17.651858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c4bea977-b327-4732-87b5-f453cc4d485b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.337709 Aug 24 14:37:17.652966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 176/319] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:17 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:17.659982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:17.660686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:17.668907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.669425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.669836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.670603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.671056 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.671475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.880510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:17.891510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-68fda1fd-b65d-481a-afa2-fcc5d6e7d1f5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.236275 Aug 24 14:37:17.892494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 177/320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:17 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:17.899463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a659d140-4e89-4973-ab33-67e484f145cd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:17.900299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a659d140-4e89-4973-ab33-67e484f145cd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:17.961225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a659d140-4e89-4973-ab33-67e484f145cd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:17.970605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a659d140-4e89-4973-ab33-67e484f145cd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1257 microversion: 2.1 time: 0.076655 Aug 24 14:37:17.971206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 178/321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:17 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:17.979766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:17.980397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:17.988693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.988693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.989156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:17.990296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:17.990961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:17.991586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.072583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:18.084752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:37:18.084752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:37:18.084752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:37:18.084752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:37:18.085399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:37:18.087013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c5502fec-5992-4a17-8dd4-dae60b2346fb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1293 microversion: 2.1 time: 0.114383 Aug 24 14:37:18.088717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 179/322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:17 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:18.100394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.101707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.102563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.103986 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.104768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.105479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.127178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:37:18.133198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Getting quotas for user 3570472f8c2b42b480ec1d1220414bec and project 7af0efe201074713a9076e220de8ea61. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:37:18.146219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:37:18.148736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:37:18.456946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2502d68d-70a4-43eb-b360-cd7dec218ae3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.199515 Aug 24 14:37:18.467669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 144/323] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:37:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:37:18.474639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-df5e83b1-0cf1-4647-a94f-fd0a67fce4f1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:18.476369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-df5e83b1-0cf1-4647-a94f-fd0a67fce4f1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:18.587869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-df5e83b1-0cf1-4647-a94f-fd0a67fce4f1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:18.595600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-df5e83b1-0cf1-4647-a94f-fd0a67fce4f1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1246 microversion: 2.1 time: 0.127651 Aug 24 14:37:18.596196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 180/324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:18 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:18.688979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:18.690350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:18.705485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.706386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.707179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.709294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.709917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.710823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.922457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:18.933104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:18.934370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:18.945090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:18.947049 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.947710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.948172 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.949068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:18.949550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:18.954258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:18.954480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:18.954480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ba1dcf4b-4b23-4fe6-8c14-2e1e7a76a8de tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.274701 Aug 24 14:37:18.955389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 145/325] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:18 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:19.007262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4381ab6c-7d6a-4aaf-9089-2b19cb91b18e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:19.009055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4381ab6c-7d6a-4aaf-9089-2b19cb91b18e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:19.127404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4381ab6c-7d6a-4aaf-9089-2b19cb91b18e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:19.147675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4381ab6c-7d6a-4aaf-9089-2b19cb91b18e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1257 microversion: 2.1 time: 0.147211 Aug 24 14:37:19.149015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 146/326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:18 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:19.158307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:19.159454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:19.171964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:19.179689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:19.180692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:19.182349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:19.183791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:19.184810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:19.211484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:19.232476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8d315e1c-d398-41ea-bc1f-eda9fe855856 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.306904 Aug 24 14:37:19.233533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 181/327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:18 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:19.298101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:19.306098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0c099649-402d-4dc8-912b-5de15d299cf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1293 microversion: 2.1 time: 0.155161 Aug 24 14:37:19.306929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 147/328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:19 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:19.629382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7fee083b-ae32-4229-9327-dc6223bd7685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:19.630036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7fee083b-ae32-4229-9327-dc6223bd7685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:19.706915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7fee083b-ae32-4229-9327-dc6223bd7685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:19.715847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7fee083b-ae32-4229-9327-dc6223bd7685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1246 microversion: 2.1 time: 0.090482 Aug 24 14:37:19.716799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 182/329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:19 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:19.984541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:19.989296 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:20.015973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.017194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.018029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.019326 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.020158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.020952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.175095 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:20.177033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:20.231406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.233746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.234924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.236617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.237713 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.238926 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.347948 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.375589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.387023 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f2c53e17-bc40-44d6-b4c5-997b149be627 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1261 microversion: 2.1 time: 0.221002 Aug 24 14:37:20.390835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.396961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 183/330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:20 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:20.413853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.417639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-219bf330-de1b-43c6-bf82-15620bd60359 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.439477 Aug 24 14:37:20.418547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:20.418780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 148/331] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:19 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:20.429664 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:20.430723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:20.433435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:20.435889 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.437067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.437836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.439065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.439850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.440698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.449608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.450425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.451266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.452448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.453618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.454376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.502283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.594514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.611134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0fb8181e-3b26-4528-add2-2507826083f2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1301 microversion: 2.1 time: 0.190224 Aug 24 14:37:20.614393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 149/332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:20 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1301 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:20.761631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:20.764940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:20.777118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.778279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.778919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.780015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:20.780741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:20.781450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:20.789958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.807716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f7d73faa-f800-49d5-ae9e-20e2772c0e68 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.409074 Aug 24 14:37:20.814989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 184/333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:20 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:20.919403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:20.932351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ffbc7d0d-4180-4a5e-b03d-6e2b00849f8a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1250 microversion: 2.1 time: 0.179810 Aug 24 14:37:20.949125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 150/334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:20 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1250 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:21.431401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:21.432678 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:21.446018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.446614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.447143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.448038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.448584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.449297 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.451848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:21.453233 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:21.486259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.487132 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.490984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.494052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.494656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.495321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.571079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:21.582681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dd80b30c-9790-4558-8c45-f23452161d8c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1309 microversion: 2.1 time: 0.158271 Aug 24 14:37:21.585732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 185/335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:21 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:21.667129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:21.667774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:21.684066 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.685184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.686050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.687266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.692209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.694244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.842568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:21.855069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a2897b9a-deae-4c44-a569-3d0546ae8a51 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1299 microversion: 2.1 time: 0.206044 Aug 24 14:37:21.867465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 186/336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:21 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:21.877715 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:21.885856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:21.887663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.888454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.889075 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:21.890287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:21.890964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:21.891558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.012527 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.039774 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.046298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.048176 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4f70c3df-c613-4ef9-a79c-9e5ed8801263 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1742 microversion: 2.20 time: 0.606965 Aug 24 14:37:22.049332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 151/337] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:21 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1742 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:22.079635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:22.080724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:22.107385 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.108137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.108595 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.109346 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.109854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.110313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.329019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.330353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.373276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-37837690-78ab-44cc-b5f9-b76af9bb6cdc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.503803 Aug 24 14:37:22.374405 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d7210efe-9051-4d65-89d3-b511bdd0abdf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1298 microversion: 2.1 time: 0.322909 Aug 24 14:37:22.374541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 187/338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:21 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:22.376777 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 152/339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:22 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1298 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:22.634235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:22.634235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:22.644518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.646512 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.647777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.650100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.651295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.653361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.894995 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:22.896495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:22.909970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:22.921082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.921082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.921082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.921082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:22.921425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:22.921425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:22.936091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0e330510-2e48-474c-a15d-2274c1d4a598 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1317 microversion: 2.1 time: 0.315388 Aug 24 14:37:22.961850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 188/340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:22 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:23.096859 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:23.097746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:23.121297 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:23.123489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:23.125728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:23.128644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:23.131691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:23.133685 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:23.655167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:23.674420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:23.679758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:23.682434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-aa012253-f217-4280-8bdb-59bfe762694a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.594412 Aug 24 14:37:23.684535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 189/341] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:23 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:23.697255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:23.698317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:23.705057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:23.705948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:23.706734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:23.712144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:23.712144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:23.712144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.021610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:24.038042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0060cf48-bd1b-46f0-8d82-a7bef81a2b7a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 1.146810 Aug 24 14:37:24.039271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 153/342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:22 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:24.057022 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:24.058133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:24.072640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.073786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.074711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.075796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.076578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.077391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.092714 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:24.124278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6f89643c-84d0-4f03-a030-c83121df66f8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.431875 Aug 24 14:37:24.129378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 190/343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:23 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:24.154244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:24.156620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:24.184847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.186367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.188747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.196396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.197668 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.199056 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.366362 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:24.406849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7810c2db-f69f-487a-87ee-6bc5817cf566 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1315 microversion: 2.1 time: 0.272557 Aug 24 14:37:24.410656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 191/344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:24 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:24.474608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "name": "network-vif-plugged", "status": "completed", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:24.520052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.528562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.530602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.588164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] Creating event network-vif-plugged:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:37:24.606276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-0ff83bbf-8684-4d99-9404-9a3962df700c req-db9d0f3c-afaf-4c11-98f7-b7c506fc6f84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175294 Aug 24 14:37:24.615197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 192/345] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:24.724272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:24.725212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:24.736643 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.741876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.742721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.744331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:24.745062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:24.745783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:24.788364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:24.989170 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:25.023943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-905faed4-a5ec-4630-958e-3132cc52f89b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1304 microversion: 2.1 time: 0.975286 Aug 24 14:37:25.032574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 154/346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:24 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1304 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:25.070618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:25.073505 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:25.135350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:25.136462 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:25.137284 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:25.143409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:25.147040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:25.148697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:25.230955 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:25.309818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:25.318628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:25.334760 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3f577652-4f3b-4fc8-9204-e017130fee04 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.614893 Aug 24 14:37:25.338521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 193/347] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:24 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:25.416017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:25.419602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:25.433834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:25.435438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:25.436550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:25.438629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:25.439743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:25.440766 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:25.961577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:25.976200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-85ff2807-a89a-43c0-9187-5953b836ea58 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.919086 Aug 24 14:37:25.977236 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 155/348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:25 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:25.991233 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:25.991972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:26.006232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.011822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.012953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.013950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.016319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.017097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.235223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:26.260709 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-74437699-176e-41cc-b0e9-4e529d118055 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.901076 Aug 24 14:37:26.260709 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 194/349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:25 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:26.276344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:26.276987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:26.296071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.296590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.297035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.297811 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.298392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.298845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.494728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:26.507056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d4f24d11-6684-4618-86ac-3a6fd5562faa tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1315 microversion: 2.1 time: 0.528060 Aug 24 14:37:26.507682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 156/350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:25 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:26.530499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:26.531277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:26.559977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.560484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.560961 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.561707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:26.562208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:26.562646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:26.719399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:26.760453 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9af214e8-260b-4cd1-82c3-76782b540fd3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1304 microversion: 2.1 time: 0.502308 Aug 24 14:37:26.775451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 195/351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:26 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1304 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:27.021483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:27.027610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:27.054559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.055401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.056156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.057370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.058011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.073600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.094812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=4 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:27.403107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:27.433123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d72d7cf4-8c42-49a0-895f-05761809087b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.412770 Aug 24 14:37:27.433123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 196/352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:27 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:27.444397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:27.445790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:27.456338 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.457567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.460062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.462034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.463203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.464243 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.881582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:27.894695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-99fa0004-c3b4-47bf-a24a-810d27599b2e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.464975 Aug 24 14:37:27.895455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 197/353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:27 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:27.903133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:27.907224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:27.922440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.931451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:27.934785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.938409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.948823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:27.950147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:27.951387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:27.951842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:27.963095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:27.967554 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e7c8d7c2-cf8f-4374-8aaf-a9a6736fa445 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 1.458423 Aug 24 14:37:27.978881 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 157/354] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:26 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:28.005786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:28.005786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:28.017101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:28.019827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:28.022728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:28.023742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:28.025001 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:28.026245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:28.119376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:28.518658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:28.574602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b19bc7d2-e7fd-465b-bbd7-f52ad9dd3739 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.676909 Aug 24 14:37:28.587008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 198/355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:27 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:28.622041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:28.624216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:28.643203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:28.645374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:28.647158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:28.649622 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:28.651018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:28.652759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.141169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=16 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:29.444109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:29.468450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ec7934f2-fdb3-4889-b2bf-861e748c78d1 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 1.488153 Aug 24 14:37:29.472431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 158/356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:27 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:29.495860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:29.496659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:29.502737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:29.504435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.505966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.507342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.508354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.509847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.510589 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.522625 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3ab0a10f-72c0-477e-b148-7eefbaf55599 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.927968 Aug 24 14:37:29.546450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 199/357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:28 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:29.546450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:29.550005 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:29.559885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.560790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.561462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.563343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.564204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.565594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.711971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=26 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:29.820952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:29.832783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:29.841683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:29.842988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-61b50905-b94c-4644-b198-55501ba41f78 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.317596 Aug 24 14:37:29.843597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 200/358] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:29 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:29.863689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:29.864716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:29.901052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.905807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.906972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:29.908557 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:29.923330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:29.924482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:30.322698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:30.336207 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5464328a-fdb4-416d-947b-5cbcf755f2a1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.481449 Aug 24 14:37:30.342410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 201/359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:29 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:30.492260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:30.498436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:30.499065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:30.505955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6c9630e7-56d4-4fb1-8cfe-43ee1491cda3 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 1.014405 Aug 24 14:37:30.507432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 159/360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:29 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:30.518493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:30.518991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:30.519624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:30.520500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:30.521911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:30.524582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:30.561142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:30.564086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:30.610082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:30.611653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:30.613154 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:30.615180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:30.622208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:30.623553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:30.985145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:31.001919 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4135df82-c893-4ffc-aa96-1742dd976a23 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.508300 Aug 24 14:37:31.010445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 202/361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:30 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:31.024680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:31.025635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:31.057683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:31.063205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:31.063656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:31.064507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:31.065541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:31.066789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:31.556232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:31.578386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:31.591464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:31.593943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9017ef4a-9143-43ea-933e-b5705d87c2be tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.581830 Aug 24 14:37:31.596798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 203/362] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:31 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:31.602491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:31.603454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:31.611758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:31.612572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:31.613189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:31.614133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:31.615902 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:31.616522 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.112824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.123696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e780f42d-8eb5-4839-8436-61eda7adca54 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.526872 Aug 24 14:37:32.124883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 204/363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:31 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:32.142615 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:32.143759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:32.159617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.160607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.163014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.163014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.165069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.166288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.317431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.348466 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2ed72499-593c-4bb7-a994-c0d60c54c1b1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 1.794963 Aug 24 14:37:32.378250 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 160/364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:30 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:32.395423 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:32.405234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:32.417483 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.418665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.419315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.420323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.420980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.421624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.478940 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.489213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-31cd655c-82ec-4693-8373-e81abf0dda70 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.361883 Aug 24 14:37:32.491305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 205/365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:32 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:32.496753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4498be-7f58-4211-bb02-944da8aa6c70", "tag": "63a7ea5c-8417-4ada-bd23-ab9523c43d0f"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:32.508448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.509606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.510578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.528791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] Creating event network-changed:63a7ea5c-8417-4ada-bd23-ab9523c43d0f for instance fc4498be-7f58-4211-bb02-944da8aa6c70 on hv-cinder-75670 Aug 24 14:37:32.538192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-425db98c-d0aa-49f4-b5fe-0df3edeb1af5 req-4a0567f4-f6cf-41cd-9185-3280c6794672 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Aug 24 14:37:32.539750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 206/366] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:32.649442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:32.651134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:32.658495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.659389 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.660044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.660993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:32.662348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:32.663020 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:32.864004 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.883062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.889213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:32.892434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e465f490-d873-4339-83cd-56423783db76 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.253663 Aug 24 14:37:32.894629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 207/367] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:32 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:37:33.072896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:33.100560 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b4921a09-f288-4db4-bcd0-7460602a5fa0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.711058 Aug 24 14:37:33.107278 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 161/368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:32 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:33.176688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:33.178483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:33.192017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.192726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.201062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:33.202156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.205208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.206181 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:33.386541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:33.394765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:33.422359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.422359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.424947 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:33.435629 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.447141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.448502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:33.780526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:33.807249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cb07f6bf-af98-4e0e-9179-4da73d8ba0dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.629592 Aug 24 14:37:33.819843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 208/369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:33 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:33.839256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:33.840385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:33.861563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.862105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.862559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:33.863301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:33.863768 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:33.864202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:34.325695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:34.360774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2faf77b8-91f9-49aa-b9f8-164785e39a5f tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.529540 Aug 24 14:37:34.361918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 209/370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:33 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:34.373129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:34.398914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:34.421827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:34.423084 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:34.428976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:34.430442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:34.431780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:34.432626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:34.433297 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:34.445226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c068011c-85cc-444a-96cb-5e8bf6ace78d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 1.067644 Aug 24 14:37:34.459063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 162/371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:33 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:34.477687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:34.478637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:34.492526 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:34.494934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:34.494934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:34.494934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:34.495524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:34.496111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:34.978291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:34.990595 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:35.007638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:35.019581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:35.023159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8d8e61be-74f6-4aac-8e83-174b645310f8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.657886 Aug 24 14:37:35.026120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 210/372] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:34 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:35.036553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:35.038106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:35.057833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.071093 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.072204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.073699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.075660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.076759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.532475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:35.548121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-feb81b2a-0955-4cdf-b8d7-a1bbabda3235 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 1.087615 Aug 24 14:37:35.574651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 163/373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:34 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:35.580381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:35.596604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.598410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.606341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.616190 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] Creating event network-changed:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:37:35.635028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-3f7c1f0e-8a5c-45b3-b406-92a14169d6d9 req-a4800453-b3db-49e0-ab01-ed7a276355a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055252 Aug 24 14:37:35.639810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 164/374] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:35.690912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:35.699354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:35.703260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:35.734052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8b8a09d8-6bbf-442c-aa66-e2d407ba5fba tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.704878 Aug 24 14:37:35.735479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 211/375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:35 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:35.753365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:35.754761 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:35.766228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.775319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.779094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.785979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.787387 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.803122 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.813840 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.814696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.815447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:35.816635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:35.829520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:35.840880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:36.168773 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:36.188108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a09a0a17-161f-4d41-b6e4-a9f47cecb709 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.451030 Aug 24 14:37:36.189637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 212/376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:35 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:36.203895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:36.206635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:36.212829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:36.226054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:36.228719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:36.229532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:36.231537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:36.232878 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:36.234723 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:36.807728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:36.828394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:36.834132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:36.837014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-edc6d427-3c85-4f0a-be73-3aa284593dbe tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.645582 Aug 24 14:37:36.858104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 213/377] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:36 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:36.874278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:36.874578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:36.893012 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:36.896130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:36.896889 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:36.912130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:36.914819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:36.916978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:36.997943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:37.015033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7d0cc6ad-997c-4391-a4db-f7ae4af73416 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 1.360458 Aug 24 14:37:37.051255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 165/378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:35 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:37.058967 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:37.059912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:37.069950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:37.078349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.079323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.086728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.088182 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.088822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.089425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.383606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:37.386710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:37.400660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4ba346ad-1dcb-4210-98a4-72156ea3cf5a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.352252 Aug 24 14:37:37.401546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 166/379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:37 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:37.423800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:37.423800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:37.433688 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.434597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.435511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.436594 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.437261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.438065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.752140 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:37.762587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e54eaae9-b779-4c51-ad7f-eea620752ddf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.357893 Aug 24 14:37:37.772295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 167/380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:37 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:37.777921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:37.792841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.793651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.799135 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.814764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] Creating event network-changed:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:37:37.822717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-9e3efb3b-e961-4548-95fb-95abc03453db req-2f3e4eb8-cea7-4419-aa1d-3f68d608e74d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048182 Aug 24 14:37:37.830076 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 168/381] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:37.895958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:37.898502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:37.926485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.927927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.933343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.936079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:37.938832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:37.940367 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:37.960145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:37.971760 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-34f0f293-e2b6-4987-93fc-ebbf564f8054 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 1.118776 Aug 24 14:37:37.976029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 214/382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:36 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:38.050687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:38.054134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:38.092978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:38.094905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:38.098158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:38.103087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:38.105795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:38.110292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:38.959833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:38.989715 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a5e65032-ab04-49b2-a6e1-b688d54aead4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1722 microversion: 2.1 time: 0.948470 Aug 24 14:37:38.997404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 215/383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:38 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1722 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:39.030425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:39.031314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:39.060821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.061327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.061771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:39.062605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.063127 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.063569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:39.286195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:39.297477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:39.299092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:39.315710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fd6132d0-86a4-4444-b803-e4c131f5b399 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 1.440484 Aug 24 14:37:39.316327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 169/384] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:37 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:39.345030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:39.345750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:39.371827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.372512 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.373025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:39.374562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.374562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.374562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:39.626053 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:39.643672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-20b30e2a-86a8-4823-aefc-ff1c01a2c089 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.642230 Aug 24 14:37:39.644836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 216/385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:38 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:39.658190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:39.663508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:39.681929 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.683317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.684846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:39.687294 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:39.689141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:39.690234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:40.341241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:40.371397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c3630b4f-e3cc-45bf-888e-18ba82546b2b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.723585 Aug 24 14:37:40.379491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 217/386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:39 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:40.404104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:40.410929 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:40.440456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:40.444647 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:40.448041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:40.454633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:40.456460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:40.459429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:40.863180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:40.895256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c76cc119-fd6f-4651-94a0-97561558b2cb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1699 microversion: 2.1 time: 0.508705 Aug 24 14:37:40.896382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 218/387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:40 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1699 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:40.904664 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:40.910130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:40.927344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:40.934196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:40.935272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:40.936833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:40.937607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:40.938319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:40.951361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:41.057011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f35a0477-b4c9-4dd2-9748-4c7adfa4bef6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 1.732078 Aug 24 14:37:41.104565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 170/388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:39 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:41.143307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:41.161562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:41.217155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:41.222945 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:41.224548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:41.225720 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:41.226532 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:41.246714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:41.260372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:41.283133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:41.286693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:41.291716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7cbb9937-327b-4970-8f90-950dae41229c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.393720 Aug 24 14:37:41.304010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 219/389] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:40 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:41.323466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:41.351861 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:41.361160 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:41.363226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:41.552633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Going to try to start instance {{(pid=127922) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:37:41.781632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:41.806303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dbd5c759-10d7-4867-aec1-4b0ef1d8c62d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.699348 Aug 24 14:37:41.809228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 171/390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:41 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:41.818220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:41.819864 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:41.832093 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:41.834117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:41.835682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:41.837109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:41.837951 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:41.843391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:42.117565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c3059992-77bb-457b-8f6d-ac36d2a2e8fb tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action" status: 202 len: 0 microversion: 2.1 time: 0.809680 Aug 24 14:37:42.123880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 220/391] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:37:41 2022] POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:37:42.153009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:42.182494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:42.246471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:42.249545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:42.249545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:42.249545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:42.252074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:42.262718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:42.315960 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:42.350407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4ea6a3e4-26e7-42cc-a8b2-e9ebb105705c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.524232 Aug 24 14:37:42.369187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 172/392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:41 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:42.374682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:42.395020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:42.436792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:42.437708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:42.438575 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:42.448944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:42.457674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:42.459472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.216634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:43.228621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-aefe2fe8-fc94-4257-bc8f-fb44469a08c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 1.102884 Aug 24 14:37:43.229231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 221/393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:42 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:43.243009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:43.251809 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:43.253409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:43.268574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.271853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-aa01c9b6-d812-4b8c-8c9e-4f8d9ffb260a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1708 microversion: 2.1 time: 0.911788 Aug 24 14:37:43.272026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.274544 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.275540 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.276165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.281252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.282866 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 173/394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:42 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1708 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:43.300013 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:43.304702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:43.326486 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.328371 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.332107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.334726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.338052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.338860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.729970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:43.742038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:43.751367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:43.757029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b9240eb0-9cf9-4fc1-8eb2-b00a6d7889a7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.521185 Aug 24 14:37:43.761039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 222/395] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:43 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:43.767322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:43.768237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:43.809615 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.810312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.810897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:43.813591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:43.815439 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:43.815973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.230558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:44.245164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c1f2f787-dbdf-455d-9f99-8cedf0d29932 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.482708 Aug 24 14:37:44.259779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 223/396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:43 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:44.259779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4498be-7f58-4211-bb02-944da8aa6c70", "name": "network-vif-plugged", "status": "completed", "tag": "63a7ea5c-8417-4ada-bd23-ab9523c43d0f"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:44.307369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.308182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.308901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.358508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] Creating event network-vif-plugged:63a7ea5c-8417-4ada-bd23-ab9523c43d0f for instance fc4498be-7f58-4211-bb02-944da8aa6c70 on hv-cinder-75670 Aug 24 14:37:44.375378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-1f53e7ef-ec60-4480-b47f-99c827440322 req-4d331ccd-c741-4dfb-8225-64ec6a65e549 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122631 Aug 24 14:37:44.386831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 224/397] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:44.402464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:44.405503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:44.419977 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.427942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.429013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.430379 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.431097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.432039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.549660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:44.561437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66682e89-bc9f-4f92-955d-61e02993e885 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 1.277067 Aug 24 14:37:44.576619 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 174/398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:43 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:44.600841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:44.603242 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:44.620788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.626114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.639940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.639940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.639940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.639940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.783794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:44.805000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-09ca87d8-c2e8-4f91-9c62-ca1f1e84c048 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.416133 Aug 24 14:37:44.809471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 225/399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:44 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:44.824021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:44.826039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:44.843055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.847042 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.849282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:44.851585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:44.852895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:44.853561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:45.217488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:45.240651 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:45.242941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:45.244466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b44c98b7-a786-414e-9bbd-df49d9d849d2 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.435501 Aug 24 14:37:45.249254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 226/400] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:44 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:45.276784 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:45.277639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:45.294966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:45.295567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:45.297140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:45.297952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:45.303794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:45.305456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:45.378330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:45.843951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:45.862646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b72cbda1-7e2d-41a1-8f13-222c6c8be5bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.586346 Aug 24 14:37:45.864912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 227/401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:45 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:45.885680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:45.885680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:45.894439 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:45.895336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:45.896637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:45.897820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:45.898489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:45.899063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.125700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:46.141623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d1ff6718-de9a-4500-a1c7-5cb0fa8d461c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.274653 Aug 24 14:37:46.142500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 228/402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:45 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:46.169707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:46.170770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:46.179829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.181706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.182733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.183883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.184358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.184886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.420676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:46.476348 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f7fc4dc7-a255-4c55-8c5a-265fb71e7431 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1708 microversion: 2.1 time: 1.892766 Aug 24 14:37:46.477351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 175/403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:44 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1708 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:46.493558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:46.512631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:46.513799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:46.514103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6fb29eb9-0734-4884-9142-8ae1aff6c5bf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1367 microversion: 2.1 time: 0.357101 Aug 24 14:37:46.515326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 229/404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:46 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:46.564158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.565043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.565795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.579824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.581095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.582160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.891944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:46.894932 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:46.925721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.926698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.927215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:46.927983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:46.928459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:46.928891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:47.572208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:47.620139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bc759981-9e66-49d4-949b-482ff20141cc tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.737459 Aug 24 14:37:47.620985 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 230/405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:46 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:47.648652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:47.649367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:47.720177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:47.720177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:47.720177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:47.720177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:47.748235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:47.748235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.137757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:48.183451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:48.188857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:48.196028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-581d9f2c-6af4-4eb8-8ac9-57b34d90c1af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 1.702307 Aug 24 14:37:48.225238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 176/406] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:46 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:48.225238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:48.225238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:48.242151 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.243582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.244698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.248047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.248969 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.249717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.585302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:48.632746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bbd58bf7-e53d-45f9-aedf-dd9089593433 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.991610 Aug 24 14:37:48.639971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 231/407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:47 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:48.678941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:48.687030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:48.719049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:48.719390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.720266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.721055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.754068 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0d79bf05-d7d3-40d9-8d4a-c2b3049e4447 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1708 microversion: 2.1 time: 0.554121 Aug 24 14:37:48.757191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 177/408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:48 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1708 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:48.764391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.765700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.775904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:48.776925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:48.778266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.800994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.803043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.806103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:48.810752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:48.812175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:48.813016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.159871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:49.175881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-eeb741f8-3b5f-4619-bef2-c716f19d7bf6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1557 microversion: 2.1 time: 0.532222 Aug 24 14:37:49.177346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 232/409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:48 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1557 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:49.234782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:49.235421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:49.247318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.249554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.250077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.250842 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.251317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.251741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.455814 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3a6070c4-bfe5-4513-b9d1-d219b725840d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.258768 Aug 24 14:37:49.457479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 233/410] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:37:49 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:49.464466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:49.468531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:49.487602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.493643 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.495442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.499907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.501538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.502308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.556164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:49.577712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e5d5cdb0-51e2-4220-a203-2912072df7f5 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.818282 Aug 24 14:37:49.605673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 178/411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:48 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:49.683359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:49.687022 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:49.703339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.704414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.705355 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:49.707314 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:49.709251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:49.710511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:50.001079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:50.018074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:50.019056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4413502e-3f9b-43a5-a570-40bc6ad1c781 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.343422 Aug 24 14:37:50.035835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 179/412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:49 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:50.043454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:50.046341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:50.053578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:50.054435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:50.055350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:50.056714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:50.057402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:50.058026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:50.099584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:50.109769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:50.115936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-54f3c0f0-8fa5-4520-8156-f45a094e078d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.655986 Aug 24 14:37:50.120116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 234/413] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:49 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:50.308757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:50.357506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2a7ba153-adae-48cf-a0b0-55bd2c76984c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1712 microversion: 2.1 time: 0.312294 Aug 24 14:37:50.374995 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 180/414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:50 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1712 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:50.626709 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:50.627933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:50.663904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:50.663904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:50.664162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:50.665452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:50.666966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:50.667978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:51.053512 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:51.070973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:51.113331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:51.114871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:51.122655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:51.122655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:51.122655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:51.134980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:51.543727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:51.559204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5ef85fb5-a7c7-41cc-89db-217c1313af9a tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.516242 Aug 24 14:37:51.575920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 181/415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:51 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:51.593646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:51.610433 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:51.612042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:51.615154 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c0e67ec2-7373-4a00-9f3a-f646e9b7d7d0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.994897 Aug 24 14:37:51.644317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:51.644317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:51.644317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:51.644317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:51.644936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 235/416] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:50 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:51.645032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:51.658962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:51.967761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:51.979816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:51.982259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:51.984340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8c19a392-4103-4080-b417-988eee68c245 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.406897 Aug 24 14:37:51.998920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 182/417] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:51 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:52.586065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:52.594691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:52.654518 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:52.655309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:52.659846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:52.665585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:52.666189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:52.681718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:52.682308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:52.682770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:52.696652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:52.697347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:52.701219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:52.701459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:52.701459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:52.707628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:53.127566 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:53.136592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:53.148223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f8d2d5dc-c313-4636-908a-70bea1ab9231 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.561181 Aug 24 14:37:53.151740 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-487ed5f7-7344-4444-bb94-134b551a9958 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.502344 Aug 24 14:37:53.152793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 236/418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:52 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:53.167120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 183/419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:52 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:53.172525 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4498be-7f58-4211-bb02-944da8aa6c70", "tag": "63a7ea5c-8417-4ada-bd23-ab9523c43d0f"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:53.172966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:53.173801 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:53.183310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:53.184082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:53.184709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:53.189378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:53.190687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:53.191356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:53.198138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:53.230525 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:53.231172 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:53.231661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:53.271673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] Creating event network-changed:63a7ea5c-8417-4ada-bd23-ab9523c43d0f for instance fc4498be-7f58-4211-bb02-944da8aa6c70 on hv-cinder-75670 Aug 24 14:37:53.280396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-5417f3c7-e255-4c14-9564-83b8fddad365 req-3c946887-1266-4301-ac1a-96c9d2722112 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119791 Aug 24 14:37:53.290737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 237/420] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:53.726336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:53.757665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:53.786678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:53.786678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-90f4f068-7dff-4985-a694-c774bf742c08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.607202 Aug 24 14:37:53.786678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 184/421] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:53 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:54.184832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:54.186592 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:54.189414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:54.192326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:54.219713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.222246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.226707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.227928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.232115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.232804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.234303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.236592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.237359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.243132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.243969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.245721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.792029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:54.822998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b0dcbe58-cc0f-4226-aa16-bfeb3126fcc6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.650912 Aug 24 14:37:54.827514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 238/422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:54 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:54.844375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:54.846261 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:54.867919 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.871502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.872820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.876970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:54.880809 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:54.881752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:54.944860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:54.972271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-974ce932-4caa-4852-b71b-0a4c1d6c7748 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.792098 Aug 24 14:37:54.980632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 185/423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:54 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:55.220162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:55.236407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:55.239651 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:55.241771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-67826176-8db2-4122-862d-721e6b98020b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.412662 Aug 24 14:37:55.242640 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 239/424] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:55.864011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:55.866850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:55.882656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:55.883917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:55.884956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:55.886475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:55.887791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:55.888801 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:56.026436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:56.027409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:56.053383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:56.056605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:56.057950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:56.059500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:56.062130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:56.065917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:56.211008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:56.226055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-72236f4f-2378-4558-a0e7-ba07129739cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.371136 Aug 24 14:37:56.243929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 186/425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:55 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:56.278702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:56.280966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:56.305840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:56.307394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:56.311219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:56.313060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:56.320050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:56.321494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:56.378503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:56.394917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3852c000-541b-4280-a9ba-ee8c78a5fbd4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.378338 Aug 24 14:37:56.396487 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 240/426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:56 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:56.657565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:56.672390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:56.675765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:56.678798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dddd1a33-8a2b-40f3-a847-3de7b7fb4cc8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.412982 Aug 24 14:37:56.679769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 187/427] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:56 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:57.260873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:57.262376 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:57.282355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.283558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.284447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:57.285554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.288025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.289733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:57.455232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:57.461453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:57.488845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.489981 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.491272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:57.494113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.496583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.497102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:57.661465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:57.680162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-553352c0-c21b-48ca-aba3-f4d721ff1101 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.430037 Aug 24 14:37:57.696504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 241/428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:57 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:57.728222 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:57.748648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:57.788897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.806292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.806292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:57.806292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:57.806292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:57.807369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:58.008463 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:58.040398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-52eb6e46-323f-48fe-a8e2-d61dcb0dcd04 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.583823 Aug 24 14:37:58.043971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 188/429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:57 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:37:58.310241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:58.334874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:58.340378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:58.343537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ff02db4d-7fcc-4bd2-a0a5-9dd45d2d83c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.619302 Aug 24 14:37:58.346142 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 242/430] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:57 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:58.793214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:58.800073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:58.813551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:58.813551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:58.813551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:58.813551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:58.816811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:58.816811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:59.057376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:59.072238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-942b0768-9c24-4909-8ed6-fe96b0b6729d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.328494 Aug 24 14:37:59.077053 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 189/431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:58 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:59.104097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:59.105314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:59.116340 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:59.117213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:59.118019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:59.119285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:59.120058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:59.120902 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:59.404208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:59.404985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:37:59.417827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:59.418536 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:59.419165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:59.424507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:59.425276 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:59.426032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:59.550296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:59.563943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dd60fc0d-a07d-4b9f-a8d3-8ae3e7235893 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.470037 Aug 24 14:37:59.564890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 243/432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:37:59 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:37:59.706938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:59.719689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:59.722678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:37:59.723471 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cdeaed65-50e0-4e13-ab68-7701c2591af8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.323061 Aug 24 14:37:59.725420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 190/433] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:37:59 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:00.104805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.108093 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:00.112577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.113454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.114690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.115911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.116580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.117171 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.292854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:00.297702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:00.307518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-40983983-fd1f-4b93-af1d-347f452514df tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.210085 Aug 24 14:38:00.309538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 244/434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:00.604256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.606072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:00.616169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.616660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.617162 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.617925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.618398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.618878 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.772599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.780286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:00.789495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.790353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.791307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.792436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:00.793204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:00.794141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:00.929291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:00.950446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1032e610-d7bc-42eb-a730-dbbf9400602b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.354059 Aug 24 14:38:00.967194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 191/435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:01.054658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:01.066654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:01.072007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:01.073491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-255ca8db-d57e-41e0-b5d9-ea617f8a35db tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.309478 Aug 24 14:38:01.074204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 245/436] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:01.349969 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:01.354872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:01.375543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:01.376915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:01.378281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:01.380558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:01.381399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:01.382326 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:01.732473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:01.732473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2dd00f4f-bc03-47cc-b184-b1a8a9df8de9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.371597 Aug 24 14:38:01.732473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 192/437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:01 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:01.994607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:01.996882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:02.020498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.022319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.023504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.025126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.025945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.026801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.107732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:02.111509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:02.137810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.139197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.140287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.143576 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.145919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.163160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.402459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:02.412517 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-04b1b8e8-c25d-4e25-ac20-3915eca1aed6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.425570 Aug 24 14:38:02.413146 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 246/438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:01 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:02.446045 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:02.456199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:02.458477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:02.460106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-427ee66b-1b0e-4c52-aedf-22f535e7f79d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.359730 Aug 24 14:38:02.460746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 193/439] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:02 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:02.749229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:02.749948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:02.759125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.759633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.760071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.760813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:02.761244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:02.761936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:02.909803 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:02.919250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8f436e66-0f0f-4ef1-80a6-9f9fc434a2dd tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.180789 Aug 24 14:38:02.919846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 247/440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:02 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:03.437742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:03.438497 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:03.458954 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.463566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.463566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:03.463566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.463566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.464263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:03.486147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:03.487719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:03.503973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.507496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.508495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:03.512080 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.514209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.514950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:03.820506 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:03.822282 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:03.834423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:03.841157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9992a13c-13e3-47dc-bd1d-a437667fd166 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.407736 Aug 24 14:38:03.843403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:03.843695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 194/441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:03 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:03.845212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bc1490c1-b0d8-49c9-a296-6e70a84aa642 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.364036 Aug 24 14:38:03.846175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 248/442] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:03 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:03.946035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:03.946709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:03.958257 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.963906 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.964931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:03.966126 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:03.966840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:03.967380 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:04.201469 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:04.205422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-60fab0cd-cc9e-45ed-b416-7ba0317513cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.267447 Aug 24 14:38:04.210079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 195/443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:03 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:04.876735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:04.878190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:04.878839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:04.880495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:04.888872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:04.889573 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:04.889950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:04.890900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:04.891623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:04.892102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:04.907517 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:04.908339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:04.909103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:04.918758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:04.919690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:04.926936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:05.155199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:05.173241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:05.176292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:05.179816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-98562bf8-56be-4cf5-a5e2-74dd59efbb2b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.308489 Aug 24 14:38:05.181222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 196/444] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:04 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:05.193210 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:05.207482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-616b9190-c9ea-477f-8e55-93e99863ed28 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.336244 Aug 24 14:38:05.209189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 249/445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:04 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:05.228001 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:05.228758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:05.240929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:05.242245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:05.243188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:05.245193 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:05.246110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:05.247236 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:05.522294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:05.538265 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a788b15c-8c39-4ebd-abbf-ea5fabaf09cf tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.314930 Aug 24 14:38:05.550575 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 197/446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:05 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:06.212596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:06.213709 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:06.223043 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.224562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.225338 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.226535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.227265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.228051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.247117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:06.248335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:06.259811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.260506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.261814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.262780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.263327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.263827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.442896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:06.454160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-75e89de9-2c4e-4ac4-8edc-4c5b0886b79a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.211895 Aug 24 14:38:06.454543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 198/447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:06 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:06.577215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:06.577902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:06.586014 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.595737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.595737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.595737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.595737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.596303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.685124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:06.695375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:06.696847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:06.698108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ab7bcbe4-dde4-4932-9e72-3b6518fb4369 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.491946 Aug 24 14:38:06.698901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 250/448] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:06 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:06.743626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:06.751904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6830ec51-9511-4231-909c-8333f120e584 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.178943 Aug 24 14:38:06.752605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 199/449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:06 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:07.478114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:07.478772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:07.481262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=76 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.487768 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.488367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.489558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.490601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.491357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.492061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.689621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:07.702190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-47bfcc83-1b7d-4a4d-b1b6-523f83d5d61e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.229017 Aug 24 14:38:07.703139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 251/450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:07 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:07.728476 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:07.729906 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:07.736128 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=68 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.742467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.743112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.743816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.744995 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.745707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.746304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.777262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:07.778142 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:07.784968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.785441 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.794890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.796484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:07.797813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:07.798740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.987470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:07.992673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:08.006189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:08.009698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:08.012341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-46f609fa-5a75-4b88-a7c5-49225d503b9c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1737 microversion: 2.20 time: 0.292205 Aug 24 14:38:08.013426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 200/451] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:07 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:08.044073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:08.059205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d88ae9ab-1b97-4f95-be09-aa303423cfd4 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.286107 Aug 24 14:38:08.070519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 252/452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:07 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:08.743508 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:08.744472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:08.752727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:08.756628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:08.756628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:08.756628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:08.756628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:08.757419 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:08.936024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:08.948333 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9a4e183b-721f-4040-a84a-a92c0c3b2576 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.210649 Aug 24 14:38:08.949356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 201/453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:08 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:09.049091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:09.050708 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:09.059189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.059788 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.060420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:09.061255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.061794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.062383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:09.099212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:09.100871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:09.113041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.115260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.116195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:09.117587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.118626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.119499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:09.263991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:09.280336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:09.286674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:09.289943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-45547329-9052-4f06-8ef8-0659a9f36d64 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1719 microversion: 2.20 time: 0.243828 Aug 24 14:38:09.290672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 253/454] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:09 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:09.386622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:09.401176 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-253bfe1e-0410-4b93-9823-5b2538ab5109 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.310281 Aug 24 14:38:09.406682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 202/455] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:09 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:09.971518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:09.972139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:09.982865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.983366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.984026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:09.984746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:09.985245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:09.985686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.143027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.151214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-981d94cb-b47e-4d2a-95c5-1b0f0d225768 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.183685 Aug 24 14:38:10.151807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 254/456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:09 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:10.329476 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:10.330560 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:10.339817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:10.340625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:10.341954 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.342736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:10.343565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:10.344299 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.440869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:10.442049 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:10.464904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:10.465744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:10.466560 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.467845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:10.468696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:10.469477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.556999 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.587363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.590666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.593295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-77a2adad-0e72-4bf2-b765-5a6ca93a429e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1719 microversion: 2.20 time: 0.269383 Aug 24 14:38:10.594367 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 203/457] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:10 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1719 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:10.691702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.719456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-38c785ad-ed62-480a-9187-32c114b2cd74 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.287777 Aug 24 14:38:10.722167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 255/458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:10 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:10.769697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "name": "network-vif-unplugged", "status": "completed", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:10.784459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:10.785118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:10.785885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:10.806437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] Creating event network-vif-unplugged:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:38:10.814152 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-dc14e5fb-0c15-4212-a13c-c921ce90a42a req-fffe6309-a26a-4d96-b43a-9a2fd9c0082d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052251 Aug 24 14:38:10.819119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 204/459] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:11.178692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:11.179834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:11.193217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.194086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.194871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.196730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.197590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.205774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.395393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:11.413851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f07d2685-a142-462e-bb06-b98dc561f14e tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.244448 Aug 24 14:38:11.416295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 256/460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:11 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:11.622923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:11.624081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:11.632453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.632964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.633398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.635267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.635758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.636191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.757130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:11.759127 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:11.769258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.771228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.772013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.773635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.774616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.775426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.890726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:11.916828 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:11.920584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:11.923411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-12f1b0e2-588c-412b-b203-71e11f1f2b85 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1719 microversion: 2.20 time: 0.309148 Aug 24 14:38:11.934545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 205/461] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:11 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:12.050144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:12.076580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-158dec48-373e-4bde-80ce-d59592b29883 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.327129 Aug 24 14:38:12.077638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 257/462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:11 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:12.442830 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:12.444120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:12.453854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:12.454656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:12.457450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:12.457450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:12.459572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:12.459572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:12.648646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:12.658104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-837e1985-6ed0-4586-a712-626e153fc9bf tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.222769 Aug 24 14:38:12.658718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 206/463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:12 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:12.955978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:12.957141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:12.971300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:12.974218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:12.974218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:12.976259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:12.977406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:12.978450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.129068 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:13.130258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:13.156187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.157275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.164746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.164746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.164746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.164746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.195233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:13.213410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:13.215674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:13.217430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7c9ba87e-64be-499e-b0ef-c54904381813 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1722 microversion: 2.20 time: 0.270805 Aug 24 14:38:13.230280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 258/464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:12 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:13.266511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9962e3e-767e-4fd9-a3e5-20a4db1795cf"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:13.266511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:13.272306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.273028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.273572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.274436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.275004 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.275528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.439678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:13.451349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8469dbdc-587d-46e4-8d49-91a0b388eeb8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.333708 Aug 24 14:38:13.452369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 207/465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:13 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:13.688414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:13.689646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:13.707660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.708818 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.709625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.710919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:13.712516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:13.713359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:13.950725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:13.961155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-12d7e418-11e3-4fdf-bbfd-186f9a56241b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.280912 Aug 24 14:38:13.961797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 208/466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:13 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:14.061353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "name": "network-vif-plugged", "status": "completed", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:14.072871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.073358 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.073796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.086622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] Creating event network-vif-plugged:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:38:14.091888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-f95bbf6e-0e0b-4b28-8fb3-2b0c41118ca3 req-5790b8d1-6296-4560-97ae-388f6ccab8c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034479 Aug 24 14:38:14.092714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 209/467] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:14.381630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:14.480861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:14.481556 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:14.519718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.520253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.524606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.527176 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.528332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.529487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.778261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:14.798733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-32f13757-10f6-4ac8-be22-ba7887e53efe tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.328136 Aug 24 14:38:14.818251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 210/468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:14 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:14.984432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:14.985168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:14.992669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.993169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.993609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.994375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.994842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.995278 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:15.063033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4b4e484a-b2f8-4be0-bdcd-21de59d19ad8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.821505 Aug 24 14:38:15.064430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 259/469] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 24 14:38:13 2022] POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments => generated 188 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:38:15.276230 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:15.289169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-781b4976-bb0e-4eac-8f7a-c741538ca6d9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.309138 Aug 24 14:38:15.292739 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 211/470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:14 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:15.485836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:15.486705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:15.493310 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.501062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:15.501062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:15.501062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.501062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:15.501913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:15.559003 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127922) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:38:15.842225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:15.843415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:15.855504 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.856336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:15.857079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:15.858316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.859388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:15.860409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.017328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-06f01513-4288-41fc-98a3-b3a13b54c5ef tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/action" status: 202 len: 0 microversion: 2.20 time: 0.535284 Aug 24 14:38:16.018440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 260/471] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 14:38:15 2022] POST /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:38:16.028435 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:16.029054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:16.037760 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:16.038306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.038744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.039693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:16.040161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.040590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.073086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:16.075185 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c14f0d91-9dec-4e1e-8bae-a29ab2cbc20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.240541 Aug 24 14:38:16.075873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 212/472] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:15 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:16.112227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "name": "network-vif-plugged", "status": "completed", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:16.131349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:16.132191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.132922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.159103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] Creating event network-vif-plugged:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:38:16.170329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-160e6be2-d921-4483-bdf7-a107ed90a938 req-867a3138-dfd1-4118-b49f-9396e4c8ed9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064687 Aug 24 14:38:16.175710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 213/473] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:16.197832 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:16.207125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:16.209498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:16.210746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-740f228e-db02-4d5f-8706-f5b9b5544107 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1748 microversion: 2.20 time: 0.186489 Aug 24 14:38:16.215843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 261/474] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:16 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:16.313882 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:16.314622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:16.322193 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:16.322744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.323144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.323850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:16.324304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.324727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.607761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:16.622150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-95763b08-f147-49cb-adbe-7ada1953f9eb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1371 microversion: 2.1 time: 0.312241 Aug 24 14:38:16.623331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 214/475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:16 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:17.111307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:17.112899 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:17.123656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.124427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.124949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.125809 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.126602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.127318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.249238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:17.249852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:17.266601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.268002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.268700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.270379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.271652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.272395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.394855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:17.404735 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d2a0f210-a65d-47cf-9365-74ab839d9234 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.297763 Aug 24 14:38:17.405333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 262/476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:17 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:17.511179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:17.522108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:17.525283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:17.526741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-51e1c5b0-cb47-4725-9b30-9a6c5d54bf62 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1748 microversion: 2.20 time: 0.284808 Aug 24 14:38:17.527627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 215/477] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:17 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1748 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:17.647799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:17.649239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:17.665738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.669144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.670771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.671538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.672024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.672461 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.944176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:17.956662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8a6165f3-08c3-42c8-803b-832e941dcc22 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1565 microversion: 2.1 time: 0.315487 Aug 24 14:38:17.970813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 263/478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:17 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1565 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:17.984239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:17.984911 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:17.997586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.000757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.001609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.002666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.006609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.007422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.202645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-35630dae-4b34-42c5-aef2-c1a0722c07c3 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222300 Aug 24 14:38:18.204319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 216/479] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:38:17 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:18.433407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.434589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:18.449419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.450324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.451520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.452967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.453895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.454831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.554851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.555850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:18.566102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.567454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.568228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.569562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.570446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.571210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.848607 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.869738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.873024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.875317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-56b7f658-2a1b-4f05-84a5-55a69897d9aa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1748 microversion: 2.20 time: 0.327710 Aug 24 14:38:18.877352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 217/480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:18 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1748 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:18.931672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.943571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c47900d1-9390-4bd3-bb3b-050e09463dc1 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1357 microversion: 2.1 time: 0.518645 Aug 24 14:38:18.944594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 264/481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:18 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1357 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:19.920384 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:19.921259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:19.930799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.931495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.932120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.932995 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.933705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.935064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.967912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:19.968786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:19.977212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.977934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.978474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.979215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.979680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.980104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:20.168018 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.175306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.179902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.183044 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e8a5d41a-1adc-4084-82d3-f8f9902e3368 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1750 microversion: 2.20 time: 0.265774 Aug 24 14:38:20.184854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 218/482] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:19 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1750 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:20.540010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.564374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5bc10e3b-4476-4985-948a-998054f12a61 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1548 microversion: 2.1 time: 0.601627 Aug 24 14:38:20.576890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 265/483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:19 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1548 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:20.615267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:20.620453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:20.640087 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:20.641361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:20.642994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:20.647547 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:20.648963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:20.650317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:20.861651 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:20.892232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:20.893221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:20.894190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:20.919023 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] Creating event network-changed:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:38:20.930868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-9bc3c79a-476e-4e23-bd4d-4fcba2de1abd req-6ef1c193-d02c-4ad9-a712-caafa7576f51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073949 Aug 24 14:38:20.932415 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 266/484] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:21.165292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:21.173616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=100 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:21.185902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6d293812-b7a7-4461-b394-439a18109e25 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1548 microversion: 2.1 time: 0.573683 Aug 24 14:38:21.186653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 219/485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:20 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1548 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:21.227273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:21.243028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:21.244138 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:21.251754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:21.263792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Searching by: {'deleted': False, 'project_id': '853f7f0f1616478c9744f93293be553e'} {{(pid=127922) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 14:38:21.273288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.288028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.291898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.294026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.295703 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.296777 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.298089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.299221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.300349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.311833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.315507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.318754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.532307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.multi_cell_list [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127922) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 14:38:21.673041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-25854277-24c8-46cd-9850-06a4b2402108 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.468271 Aug 24 14:38:21.673654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 267/486] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 14:38:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:21.706368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:21.708051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:21.716272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.717137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.731787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.734641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.738035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.739117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.979481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:21.996234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f1af60e2-e9f3-42e6-b5dc-f614443a7045 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1548 microversion: 2.1 time: 0.298025 Aug 24 14:38:21.997530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 268/487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:21 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1548 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:22.131896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:22.149853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:22.159457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:22.164317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0d21cc6f-ad7f-4008-aa09-fb39e07122fd tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1750 microversion: 2.20 time: 0.945242 Aug 24 14:38:22.182033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 220/488] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:21 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1750 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:23.202593 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:23.204076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:23.212385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.213266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.214299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.215269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.215966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.216576 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.585196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.610483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.617645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.622697 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e95e5474-51c6-4156-9419-edc8a5d8b4d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.422897 Aug 24 14:38:23.625719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 269/489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:23 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:24.617184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8136c275-6bc9-4de4-ba87-4b71371aa893"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:24.619714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:24.626675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.630391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.630391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.630391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.630391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.630976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.681713 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:24.681713 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:24.709603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.710395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.711414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.714126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.727868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.727868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:25.075032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.096150 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.100728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.103545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b8b89cba-1063-404e-8681-9786f0010802 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.440933 Aug 24 14:38:25.105448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 270/490] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:24 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:25.907142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e252a8a7-48ac-459b-bbcd-0dd4ba4abe1f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.294652 Aug 24 14:38:25.920437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 221/491] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:38:24 2022] POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments => generated 194 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:26.151517 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:26.152635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:26.181146 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.184144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.184859 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.189637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.191092 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.193078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.739911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.804038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.808630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.817947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b76a68ab-f82f-4fff-b858-e20896b8bcf7 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.672974 Aug 24 14:38:26.823486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 271/492] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:26 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:27.853327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:27.856442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:27.870686 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.880334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.881439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.886759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.887966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.905281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:28.206262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.219674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.222235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.224811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bc3f279a-6b86-49b1-a60b-777cc7fa5643 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.380647 Aug 24 14:38:28.237076 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 222/493] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:27 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:29.255302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:29.256992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:29.264872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.265397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.266059 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.267564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.268497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.280329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.690672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:29.690672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:29.690956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:29.690956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b50c6bf0-3301-4570-a455-3240ce200662 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.303655 Aug 24 14:38:29.690956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 272/494] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:29 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:30.732180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:30.733279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:30.745911 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.746921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.747623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:30.748663 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.749359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.750066 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.022874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.038050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.040786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.042923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4ad96133-ad22-448f-92ac-b240d98609e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.317331 Aug 24 14:38:31.043791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 223/495] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:30 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:32.076586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.077764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.088677 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:32.092732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.093312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.093972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.094968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.095458 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.095894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.343145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.344338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.352979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.353855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.354492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.355721 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.356194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.356625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.398780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.429230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.432225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.434372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-71102c62-8648-42c2-a843-724651c189af tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.368842 Aug 24 14:38:32.435679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 273/496] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:32 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:32.623549 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lazy-loading 'services' on Instance uuid c0a79bb8-4962-4c32-bafd-b5759bea2607 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:38:33.029525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-90dd4280-99f2-411d-9694-60bbe6e4297a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments/b7780f14-a37f-4658-a742-8b0762d0a54d" status: 202 len: 0 microversion: 2.1 time: 0.691048 Aug 24 14:38:33.030180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 224/497] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:38:32 2022] DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments/b7780f14-a37f-4658-a742-8b0762d0a54d => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:38:33.485717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:33.489777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:33.500129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.500951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.502042 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.503662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.505263 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.506328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.883954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.898454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:33.908282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.916247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.920783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-27fb0a92-5a25-4d60-b663-f3690e810c54 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.441528 Aug 24 14:38:33.923334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 274/498] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:33 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:34.953280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:34.969016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:34.969016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.969016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.969016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.969710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.969710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.969710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.200788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:35.203370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:35.204874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:35.206241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dedd1f9d-bd4d-4e2c-b542-4816011ab4bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.261200 Aug 24 14:38:35.206842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 225/499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:34 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:35.664507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.665430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.678700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.679552 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.680273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.681662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.682509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.683386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.730353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e01b7f90-625a-43c3-af16-7bf1f3f74ea8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/ips" status: 200 len: 150 microversion: 2.1 time: 0.072532 Aug 24 14:38:35.737741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 275/500] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:38:35 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:35.755419 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e144cc-7b97-42a7-9f6a-285140ee11cf"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:35.759403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.774800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.784569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.784569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.784569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.784569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.785940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.916053 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: POST /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/os-volume_attachments HTTP/1.1 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 74 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:38:35.917892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {"volumeAttachment": {"volumeId": "d1e144cc-7b97-42a7-9f6a-285140ee11cf"}} Aug 24 14:38:35.919464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'server_id': 'fc4498be-7f58-4211-bb02-944da8aa6c70', 'body': {'volumeAttachment': {'volumeId': 'd1e144cc-7b97-42a7-9f6a-285140ee11cf'}}} Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:38:35.924049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:35.934863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 400 to user: Invalid volume: volume d1e144cc-7b97-42a7-9f6a-285140ee11cf is already attached to instances: a9601091-8514-4244-b7ae-a6921fd9fa7a {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c8eea15a-3f55-4120-97fe-2a07a0c696dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171370 Aug 24 14:38:35.937130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 226/501] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:38:35 2022] POST /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:38:35.938106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.938106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.942369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.943022 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.943567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.944282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.944746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.945234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.982276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:38:36.230266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:36.230877 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:36.239315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.239804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.240335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.241043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.241503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.241924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.405613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3fb31187-6c36-4a8a-a7e2-c4531fb043dc tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 204 len: 0 microversion: 2.1 time: 0.479963 Aug 24 14:38:36.406465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 276/502] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:38:35 2022] DELETE /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:38:36.422727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:36.423733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:36.431853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.432602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.433177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.433621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.434407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.435079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.435877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.449581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.452907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.455286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-64330b13-e6cc-4f3d-a329-3eca6460f7ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.228528 Aug 24 14:38:36.466316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 227/503] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:36 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:36.589689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.598538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f47e0674-1bcb-42ac-98ba-451e86d06826 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1682 microversion: 2.1 time: 0.181989 Aug 24 14:38:36.599190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 277/504] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:36 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:37.486123 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.487153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.496748 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.497616 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.498457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.499696 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.500248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.500813 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.626957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.628210 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.642402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.643213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.644007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.646927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.647863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.648671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.661127 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.677161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.680227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.682458 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c0fb25ab-2a89-45a4-bfbf-138ce1c787bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.200692 Aug 24 14:38:37.683467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 228/505] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:37.847240 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.861738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8f7c87e0-c1fa-4259-b3dc-7e2de0d78e9c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1682 microversion: 2.1 time: 0.241673 Aug 24 14:38:37.863058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 278/506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:38.709056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.710117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:38.713863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=58 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:38.724065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.724610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.725076 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.725898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.726506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.727115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.896164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.897157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:38.902185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:38.913193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.914101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.914907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.917152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.918017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.918840 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.945116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.957572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.959761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.961338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-666ce5a9-cf6a-4669-a0ce-ea260aae4147 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.257915 Aug 24 14:38:38.962375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 229/507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:39.199923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.215996 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a94d5f4b-aea5-4867-a30d-d8d7cd59fd2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1682 microversion: 2.1 time: 0.330049 Aug 24 14:38:39.217045 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 279/508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1682 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:40.008626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.009793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:40.050120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.051836 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.052474 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.053726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.061825 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.062681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.252393 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.253521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:40.261366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.261855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.262318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.263030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.263483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.263910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.353904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.377685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.379336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.383229 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-096e3f2a-ebc3-4e82-8dfd-62a21e0f6c27 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.381926 Aug 24 14:38:40.383229 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 230/509] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:39 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:40.472813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.487630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7c50367f-7b3a-4eb9-8226-2e8d29a1891c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1682 microversion: 2.1 time: 0.238114 Aug 24 14:38:40.490234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 280/510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:41.408615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:41.409473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:41.417264 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.418170 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.418618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.419359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.419815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.420228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.522830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:41.525138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:41.538327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.539885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.540854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.542406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.543307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.544157 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.845136 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.860886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9d9124bc-b7bc-48a8-8225-3f74feab35aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1682 microversion: 2.1 time: 0.345470 Aug 24 14:38:41.868563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 281/511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:41 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1682 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:41.924093 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.953640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.966099 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.967793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b9bc9c37-78d3-4b34-bec5-a111afea3e16 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.565272 Aug 24 14:38:41.971677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 231/512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:41 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:42.887693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:42.887693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:42.902548 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.903056 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.903507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.904344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.904854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.905283 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.014280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:43.020586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:43.060894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.061853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.064330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.066359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.069118 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.069864 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.159964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:43.179608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9de7c57f-8c88-4ee2-97e7-da99065f9d6b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1614 microversion: 2.1 time: 0.296862 Aug 24 14:38:43.182752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 282/513] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1614 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:43.194789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:43.200672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:43.218812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.225652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.226866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.230033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.230705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.231899 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.692078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:43.741939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:43.745951 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:43.755230 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c9c44f20-18ea-408b-ab35-7e2acb938e80 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.759934 Aug 24 14:38:43.756671 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 232/514] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:43.779567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:43.784078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4498be-7f58-4211-bb02-944da8aa6c70", "name": "network-vif-deleted", "tag": "63a7ea5c-8417-4ada-bd23-ab9523c43d0f"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:43.822356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c7877575-f32a-4c7d-8b6a-153f9b4ec389 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1594 microversion: 2.1 time: 0.637373 Aug 24 14:38:43.823750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 283/515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:43 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1594 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:43.829115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.832970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.832970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.843259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:43.867917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.868782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.872467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.883907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] Creating event network-vif-deleted:63a7ea5c-8417-4ada-bd23-ab9523c43d0f for instance fc4498be-7f58-4211-bb02-944da8aa6c70 on hv-cinder-75670 Aug 24 14:38:43.904143 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-10e5245a-ab7a-4f28-b62c-9455dc0b18f8 req-3b7fc5d0-e589-4613-8b3f-90710910e2ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140505 Aug 24 14:38:43.905432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 233/516] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:43.924819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Going to try to stop instance {{(pid=127922) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:38:44.233300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:44.235958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:44.278292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.280869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.282906 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.296360 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.297873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-97aa1dec-3580-4801-a5c8-99c63f0acda6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action" status: 202 len: 0 microversion: 2.1 time: 0.470729 Aug 24 14:38:44.298528 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.299405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 284/517] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:38:43 2022] POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:38:44.312992 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.315847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "name": "network-vif-plugged", "status": "completed", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:44.354372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.359201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.359201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.400942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] Creating event network-vif-plugged:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:38:44.408333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-c8942ee5-0271-4a97-80ed-a0eb7af4f4d1 req-8d5db6cb-1ac8-421c-b3dd-9b717bcc7ddc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106062 Aug 24 14:38:44.410032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 285/518] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:44.420660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:44.422532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:44.434056 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.435282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.435791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.436654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.437239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.437777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.495465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.496414 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.500173 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.501146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid fc4498be-7f58-4211-bb02-944da8aa6c70 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:38:44.601843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.612171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:44.616344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9a98056a-f83b-4a8d-8595-bb82dbbb6a64 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1331 microversion: 2.1 time: 0.393616 Aug 24 14:38:44.617110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 234/519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:44 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:44.764228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.779226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1ada0e9b-514d-4121-8733-42de6d41a1fc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.365913 Aug 24 14:38:44.780375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 286/520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:44 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:44.808597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:44.809540 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:44.820845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.825294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.826168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.830298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.831479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.832839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.296279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.334245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.339357 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.342827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bc2150ac-b59c-404b-87d2-6ce73329082c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.538790 Aug 24 14:38:45.344988 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 235/521] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:44 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:45.658204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.658796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.671238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.671742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.672178 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.681501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.682269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.682732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.762569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.763334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.765018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.765967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid fc4498be-7f58-4211-bb02-944da8aa6c70 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:38:45.812261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.813370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.823197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.840874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a3d89b17-4c1e-4b92-9d7c-d23675d0b342 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1331 microversion: 2.1 time: 0.186978 Aug 24 14:38:45.841923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.854376 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 287/522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:45.863833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.864435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.865388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.865908 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.866364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.251316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.271792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dc33cc0c-5214-404c-93b5-bce8863e39fa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.469537 Aug 24 14:38:46.273109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 236/523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:46.389395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:46.390274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:46.412855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.414934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.416877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.423238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.423238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.423238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.721534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.742357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.747463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.750731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d7f70e82-0ea8-4f2f-9040-33c841319ebc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.365852 Aug 24 14:38:46.753197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 288/524] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:46 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:46.874858 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:46.882581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:46.893220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.895151 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.896362 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.898200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.899479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.900321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.973520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.974783 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.975796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.976759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid fc4498be-7f58-4211-bb02-944da8aa6c70 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:38:47.118902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.132987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9f44973f-818f-466b-96b0-e1e0063b3c9d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 200 len: 1331 microversion: 2.1 time: 0.265621 Aug 24 14:38:47.134127 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 237/525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:46 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 1331 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:47.299221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:47.300290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:47.315907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.317419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.318476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.320287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.321361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.322345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.371384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:47.558605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.572620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0347734a-92d9-4ed5-bc5e-97fc68e43948 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.277537 Aug 24 14:38:47.573808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 289/526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:47 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:47.780559 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:47.782149 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:47.796410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.797939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.798625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.800109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.801368 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.802582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.111693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:48.132758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.133531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.133973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.162604 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] Creating event network-changed:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:38:48.173597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-b90cf9ea-2752-4408-a71d-a07b61fca58f req-17228cbb-8995-4c9f-ac09-f9e0ef8f49c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066447 Aug 24 14:38:48.175924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 290/527] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:48.180940 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.191316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.222731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.222731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ecea1593-f9d7-4d82-9a6c-b36934abaee8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.427772 Aug 24 14:38:48.222731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 238/528] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:47 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:48.223081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.223081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.230027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.231226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.232299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.233694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.234689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.236499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.271705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 HTTP/1.1 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:38:48.277475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:38:48.279166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'fc4498be-7f58-4211-bb02-944da8aa6c70'} Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:48.280035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:38:48.281285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:38:48.282633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:48.282633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5c7fd013-4486-460f-9ac2-ba6f1fac417d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 404 len: 111 microversion: 2.1 time: 0.088868 Aug 24 14:38:48.283553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 291/529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:38:48.293791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bac75f25-27f2-42a8-ac8b-a65ca287059e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '.version_select at 0x7f8a8c1a4a60>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.441640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bac75f25-27f2-42a8-ac8b-a65ca287059e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065514021" status: 202 len: 0 microversion: 2.1 time: 0.151611 Aug 24 14:38:48.447703 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 239/530] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 14:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065514021 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:38:48.603733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.607094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.618546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.619638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.622870 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.624388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.627053 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.630973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.016331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.036669 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-aae72177-4210-4771-b62d-911272db50c5 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.442167 Aug 24 14:38:49.037779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 292/531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:49.244039 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:49.246264 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:49.259360 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.266976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.272298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.278388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.281002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.284115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.910099 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.927091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.931587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.932791 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-58372620-582d-4a7d-9b76-f5db6822d306 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.697677 Aug 24 14:38:49.933317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 240/532] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:49 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:50.079092 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:50.080414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:50.096876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.099437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.100637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.103475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.104384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.105176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.340954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:50.352266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c2098192-4004-42bc-9b27-423d25e3a451 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.282549 Aug 24 14:38:50.353195 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 293/533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:50 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:50.904149 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:50.905166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:50.921345 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.922196 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.922895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.924080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.924821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.925539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.005981 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.007117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:51.018543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.026396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.026396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.026396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.026396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.028133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.268824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'services' on Instance uuid a9601091-8514-4244-b7ae-a6921fd9fa7a {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:38:51.327214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.338476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.340020 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.341244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8749ff27-ce5a-4741-b6fc-dd84d4ed4f65 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.343606 Aug 24 14:38:51.341900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 294/534] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:50 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:51.383810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.384915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:51.397421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.398400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.399462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.400963 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.401853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.403439 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.582767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.591149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7372aa5a-deba-460f-868a-be81526a5343 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.216199 Aug 24 14:38:51.592700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 295/535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:51.954212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2343fa9f-df70-49ec-bdb6-8a1cb61e5dd3 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments/d1e144cc-7b97-42a7-9f6a-285140ee11cf" status: 202 len: 0 microversion: 2.1 time: 1.057288 Aug 24 14:38:51.955008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 241/536] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:38:50 2022] DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments/d1e144cc-7b97-42a7-9f6a-285140ee11cf => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:38:51.969779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.975481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:51.986942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.987838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.989211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.990477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.991241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.991993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.050381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-761c4cd5-8b39-4c4d-9db0-28a5ea5a86c6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087799 Aug 24 14:38:52.051489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 296/537] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:52.374246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.376101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.388794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.389795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.390618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.391868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.392744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.393504 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.605161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.619085 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.620949 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.622288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b93dabb4-b912-4c1d-a3d5-2e13f300b5b6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.259522 Aug 24 14:38:52.623143 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 242/538] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:52.623986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.624988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.634123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.635052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.635813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.636843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.637477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.638071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.795945 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1232349754"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:52.796716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.835961 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.836989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.837784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.839091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.839936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.840707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.861478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.886226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-00200c0a-4ed4-4f6e-99b5-0af6b1de0427 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.263919 Aug 24 14:38:52.886226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 297/539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:53.015700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.network.security_group_api [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Adding security group c6860e17-4ee9-44cb-bb7e-b2e235b8f24c to port c3b1b235-fcff-4cfb-8e30-7f144b5c28fc Aug 24 14:38:53.067373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.069672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.076541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.077117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.077559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.078322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.078865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.079268 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.119769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-df222c7a-e3be-468d-8352-63faf1ab3e2c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057125 Aug 24 14:38:53.125046 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 298/540] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:53.570484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a0b5f2aa-234b-4240-925d-22ab5315a448 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action" status: 202 len: 0 microversion: 2.1 time: 0.779120 Aug 24 14:38:53.576520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 243/541] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:38:52 2022] POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:38:53.583071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.583879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.591306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.591794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.592250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.592942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.593475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.594106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.598939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:53.614993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.616088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.617208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.643369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] Creating event network-changed:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:38:53.653073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-79a6c63b-6108-46fd-b971-0f3c556539ab req-f45b508d-ddfb-47be-9f45-082cd2909e39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057770 Aug 24 14:38:53.654800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 244/542] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:53.661376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.662558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.671569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.672114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.672603 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.673444 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.674382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.675040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.819135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.834770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3130f56e-78a8-4f65-adaa-286364927bc3 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1759 microversion: 2.1 time: 0.256466 Aug 24 14:38:53.835960 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 299/543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1759 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:53.886464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.904226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.906763 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.907435 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.907690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.910298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3e168e90-66b7-420d-8581-0a5b6caa59e0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.253512 Aug 24 14:38:53.912532 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 245/544] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:53.915117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.915671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.916107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.916813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.917264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.920848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.075799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.091785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9fabe4de-d423-401f-86ba-2f15a2005ee2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.188855 Aug 24 14:38:54.092882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 300/545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:54.133598 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:54.135834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:54.142840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.143331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.143768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.144567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.145021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.145441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.188046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-15b5892b-167e-45ca-8dd1-56591b0a7fb8 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059250 Aug 24 14:38:54.188563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 246/546] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:38:54 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:54.940573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:54.941451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:54.948560 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.950094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.950571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.951609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.952093 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.952528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.142747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:55.146088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:55.155415 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.160961 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.161534 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.161985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.163108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.163737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.164317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.176590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.180405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.184124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f4ab720d-a553-4016-bac5-78b024bb9ce3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1806 microversion: 2.20 time: 0.247728 Aug 24 14:38:55.190219 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 301/547] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:55.211214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:55.217980 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:55.234466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.235188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.237212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.239785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.240063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.244438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.311012 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-38a71472-f406-42e8-b999-568d2c417f25 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111651 Aug 24 14:38:55.312684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 302/548] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:38:55 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:55.427340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.445085 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-15d058e3-b338-4586-8cc6-a0fe4ec7f9bc tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.316324 Aug 24 14:38:55.451402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 247/549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:55 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:56.227930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.229187 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.236699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.237733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.238613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.239816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.240414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.240881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.327632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.331687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.344289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.345519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.346797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.349826 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.350484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.351193 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.405898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a82bb348-09d2-402b-a169-0a0efed3c51c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084844 Aug 24 14:38:56.407055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 248/550] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:38:56.468808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.478739 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.479835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.480018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.482200 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.483640 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d01330e7-cd05-44a1-9823-9124604330b3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1793 microversion: 2.20 time: 0.260794 Aug 24 14:38:56.484240 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 303/551] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1793 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:56.490605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.491479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.492684 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.494645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.495700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.496689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.521267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.521914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.530081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.530641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.531130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.531806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.532528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.533041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.563445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:38:56.730887 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.740146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b15ed559-d616-4fc9-ad9b-352ad07f25ee tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.268837 Aug 24 14:38:56.740987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 249/552] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:57.154676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-435bd288-30a6-4251-a110-0a785d377151 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 204 len: 0 microversion: 2.1 time: 0.645016 Aug 24 14:38:57.155866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 304/553] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:38:56 2022] DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:38:57.165512 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.166370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.173475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.173972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.174453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.175169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.176490 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.177291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.349276 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.358179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ce01503e-bee6-4323-8617-349c940ef6f5 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1681 microversion: 2.1 time: 0.197656 Aug 24 14:38:57.359134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 250/554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:57.773562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.775041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.782242 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.782750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.783186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.783903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.784390 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.784963 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.961676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.967817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:57.978406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e05d6bc2-c380-4854-81cc-8274e1fed083 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.209951 Aug 24 14:38:57.979262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 305/555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:58.381492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:58.382364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:58.390363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.390956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.391467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.392326 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.392808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.400645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.565623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:58.575746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-006867ba-ad53-43f0-948f-3a00c25c221e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1681 microversion: 2.1 time: 0.198941 Aug 24 14:38:58.576406 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 251/556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:58 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:59.015142 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:59.015860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:59.025599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.026192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.026637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.027373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.032438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.032438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.212545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.222273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6029ccf7-1c1d-4762-9d44-9ff46a8cd644 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.211999 Aug 24 14:38:59.223722 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 306/557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:59 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:59.604518 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:59.605340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:59.612770 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.614186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.617062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.617062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.617062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.617062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.634343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:59.912832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.926926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5eeaae26-7d4d-4fd2-8793-171e4917c509 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1681 microversion: 2.1 time: 0.325900 Aug 24 14:38:59.928208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 252/558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:59 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:00.248336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:00.249189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:00.261772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.262688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.268481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.272364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.275764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.277025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.480869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:00.493839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b6bbac59-13bc-4826-8d67-f5ecb426cbe8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.249803 Aug 24 14:39:00.494860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 307/559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:00 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:00.577221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9601091-8514-4244-b7ae-a6921fd9fa7a", "name": "network-vif-deleted", "tag": "6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:00.591441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.593349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.594248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.611617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] Creating event network-vif-deleted:6b0eaf0d-fdd8-4e16-a79e-e5e5aed9a2d0 for instance a9601091-8514-4244-b7ae-a6921fd9fa7a on hv-cinder-75670 Aug 24 14:39:00.618798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-5cec6309-7990-4a68-922f-2c455c16899f req-789c616e-2745-47ea-8397-f5abdd3a467b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045908 Aug 24 14:39:00.623864 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 253/560] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:39:00.964833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:00.965892 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:00.987018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.987503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.988083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.989387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.990107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.990551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.031632 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.033152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.033950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.035482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid a9601091-8514-4244-b7ae-a6921fd9fa7a {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:01.091469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.109154 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e00670a8-f9f8-4f3e-a7fe-306cd02e7f11 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1331 microversion: 2.1 time: 0.148385 Aug 24 14:39:01.110055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 308/561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:00 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:01.728535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:01.728535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:01.728535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.728535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.731246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.731246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.731246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.731246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.758582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.771161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-942bbea1-90e6-4fca-b1e3-3ea61f80a2e6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.253944 Aug 24 14:39:01.772086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 254/562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:01 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:02.136778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.140523 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.157847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.159006 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.160521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.161584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.162420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.163394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.211189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.211890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.212596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.213177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid a9601091-8514-4244-b7ae-a6921fd9fa7a {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:02.289248 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.302745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fa02a5aa-bb0e-4dbe-9da1-88a83011b797 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 200 len: 1331 microversion: 2.1 time: 0.176072 Aug 24 14:39:02.303687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 309/563] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:02.795390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.796067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.805002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.805515 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.805944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.806732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.807281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.807779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.992608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.002834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1a84ef3b-afc5-4b15-8868-09c2251a4ca6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.211361 Aug 24 14:39:03.006003 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 255/564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:03.325528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.326252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:03.340793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.340793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.340793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.340793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.341288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.341288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.353101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a HTTP/1.1 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:39:03.355140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:39:03.357742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'a9601091-8514-4244-b7ae-a6921fd9fa7a'} Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:03.359330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:39:03.360818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:03.362797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:03.362797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b939249d-7437-4ebf-9681-24d6129d7d97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 404 len: 111 microversion: 2.1 time: 0.035188 Aug 24 14:39:03.362797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 310/565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:03 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:39:03.371659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ce991f97-ca96-4dcd-a1df-c06387184a18 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '.version_select at 0x7f8a8c16b670>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.493430 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ce991f97-ca96-4dcd-a1df-c06387184a18 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688464293" status: 202 len: 0 microversion: 2.1 time: 0.130279 Aug 24 14:39:03.494368 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 256/566] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 14:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688464293 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:39:04.034076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:04.037107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:04.049628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.050190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.051336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.052634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.053320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.053880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.293154 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.313061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-035a6380-c7cd-4ddb-9d8e-97e107559c83 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1676 microversion: 2.1 time: 0.285036 Aug 24 14:39:04.314033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 311/567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:04 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1676 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:04.774446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f71f77e4-5e2f-4db0-83e2-1ad324528744 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: .version_select at 0x7f8a8c0e0dc0>, body: {"keypair": {"name": "tempest-keypair-668698881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZ/0c61dcALVGZvixPQKoBvZHy6rsPgY6+e6sMLt73E7ktIKYxphWFVq03h1+U5ZMAshAi6Ru1kySNPWN/wp9fnnIVySnMSNLH2Dy08VZUph/dBTeFZjZ/uqZwvYqWpnw=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:04.797510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-f71f77e4-5e2f-4db0-83e2-1ad324528744 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:39:04.803546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-f71f77e4-5e2f-4db0-83e2-1ad324528744 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:39:04.949964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f71f77e4-5e2f-4db0-83e2-1ad324528744 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180039 Aug 24 14:39:04.950830 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 257/568] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:39:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:05.344308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:05.358825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:05.358825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.358825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.358825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.359502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.359502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.359502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.536796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:05.536796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7885a7ff-9fc1-4e20-ab84-1aeb755a8287 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1653 microversion: 2.1 time: 0.192129 Aug 24 14:39:05.536796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 312/569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:05 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1653 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:05.553943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:05.561071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.561447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.561956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.588255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Going to try to start instance {{(pid=127923) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:39:05.921098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-922a7217-7849-4c54-8e74-cad63d4e6176 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action" status: 202 len: 0 microversion: 2.1 time: 0.370808 Aug 24 14:39:05.923191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 258/570] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:39:05 2022] POST /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:39:05.932178 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:05.932825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:05.939466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.939958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.940722 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.941611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.942382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.942824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.189508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.204637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4c686542-ffe8-4e11-ab82-1932bb1453ab tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1662 microversion: 2.1 time: 0.276706 Aug 24 14:39:06.205788 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 313/571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:05 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:07.229891 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:07.231173 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:07.239776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.240316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.240803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.241568 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.242114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.242568 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.402402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:07.438073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a87eba16-3cde-4137-9347-dd6efbf32569 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1662 microversion: 2.1 time: 0.195339 Aug 24 14:39:07.451107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 259/572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:07 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:08.465473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:08.476808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:08.476808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.476808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.476808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.477286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.477286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.477286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.692124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.706122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6b279629-30da-47c3-8193-b6ab6ebd9897 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1666 microversion: 2.1 time: 0.244109 Aug 24 14:39:08.707199 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 314/573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:08 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1666 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:08.918641 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2135876083", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c1b2e1f-70b2-4451-9050-eb07b892f67d"}], "security_groups": [{"name": "tempest-securitygroup--1428419552"}], "key_name": "tempest-keypair-668698881", "user_data": "}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:08.929101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:09.204451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] validate_networks() for [('9c1b2e1f-70b2-4451-9050-eb07b892f67d', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:39:09.653213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:39:09.654395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:39:09.655100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:39:09.655793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:39:09.656464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:39:09.681069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.682235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.683052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.686928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.687526 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.688046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.709531 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:39:09.714377 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:39:09.727741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:39:09.730086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:39:09.859221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ddd5bcdc-b488-43bb-bdcc-86cf3d08d4b4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.947669 Aug 24 14:39:09.859879 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 260/574] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:39:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:39:09.880800 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-08d8f8d0-e936-4228-b3de-77bc5cae07b2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:09.881885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-08d8f8d0-e936-4228-b3de-77bc5cae07b2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:09.886189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:09.955990 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-08d8f8d0-e936-4228-b3de-77bc5cae07b2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:09.964087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-08d8f8d0-e936-4228-b3de-77bc5cae07b2 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1241 microversion: 2.1 time: 0.091059 Aug 24 14:39:09.964846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 315/575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:09 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:10.993886 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7725d160-14fa-4646-98d9-4de110e072ac tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:10.994678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7725d160-14fa-4646-98d9-4de110e072ac tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:11.073687 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7725d160-14fa-4646-98d9-4de110e072ac tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.081628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7725d160-14fa-4646-98d9-4de110e072ac tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1241 microversion: 2.1 time: 0.093423 Aug 24 14:39:11.082409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 261/576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:10 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:12.117354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:12.117970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:12.127149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.129897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.131601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:12.133447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.134275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.135019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:12.211524 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:12.220243 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-484a6e6b-7668-417f-a0ef-a6ecc6e9d008 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1293 microversion: 2.1 time: 0.107631 Aug 24 14:39:12.220805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 316/577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:12 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:13.244704 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:13.244704 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:13.251407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.252103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.252306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.253028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.254319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.254730 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.475265 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.485020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-96230c14-40a1-4c50-a42b-fc69c887db84 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1299 microversion: 2.1 time: 0.245527 Aug 24 14:39:13.486334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 262/578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:13 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:13.994533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:13.997088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.005301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.005960 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.006437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.007159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.008778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.008778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.263635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f6cb6a61-27a8-43d7-8881-67b5f5c319c9 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action" status: 202 len: 0 microversion: 2.1 time: 0.272989 Aug 24 14:39:14.269815 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 317/579] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:39:13 2022] POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:39:14.275553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:14.276532 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.290334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.295364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.295364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.295364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.295364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.296007 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.520279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:14.521602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.528895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.529400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.529848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.530658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.531130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.531559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.689269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.698552 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-39658812-19f2-4feb-a8ca-f35bf76ab3cf tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.183031 Aug 24 14:39:14.699153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 318/580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:14 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:14.830870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.840865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d554dd80-2f20-46ab-aa02-5fbe0d37507e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1751 microversion: 2.1 time: 0.569432 Aug 24 14:39:14.841676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 263/581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:14 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1751 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:15.568717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9069459-afe6-441a-ada9-34cd892cb3f0", "tag": "c08f1f49-be2c-4f14-b933-c86999566efe"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:15.580373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.580870 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.583455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.595290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] Creating event network-changed:c08f1f49-be2c-4f14-b933-c86999566efe for instance d9069459-afe6-441a-ada9-34cd892cb3f0 on hv-cinder-75670 Aug 24 14:39:15.602262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-7b9f1f18-a9de-42cf-ad90-d78fc9a6f49d req-3b16ddd6-2f85-4e95-bc9d-4b44c24d9321 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041766 Aug 24 14:39:15.603190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 319/582] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:15.724492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:15.725644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:15.738464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.739344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.740128 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.741488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.742416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.743220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.872190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:15.873434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:15.887915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.889318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.890684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.892412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.893350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.894275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:16.018493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.027868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6061b37a-8a87-4893-98f8-bb2869335b97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.310975 Aug 24 14:39:16.028484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 264/583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:15 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:16.075549 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.085073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-870941de-10d6-4f35-8256-31ae11add314 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.222701 Aug 24 14:39:16.085673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 320/584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:15 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:17.049692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:17.050448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.058599 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.059096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.059539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.060265 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.060727 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.061156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.111360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:17.112317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.120289 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.120884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.121328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.122084 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.122577 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.123005 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.248493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.257022 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-86c0211e-9f83-40eb-8a4b-df62fa19bafb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.212117 Aug 24 14:39:17.259615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 265/585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:17 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:17.272313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2460ff86-d072-4236-995e-22cb50cbd516"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:17.272313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.276493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.277356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.281286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.283266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.284305 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.285461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.611066 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.621008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-380f5e8d-95dd-4476-b2c8-1b75ded64416 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.514612 Aug 24 14:39:17.621970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 321/586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:17 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:18.288194 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:18.288930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:18.296601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.297102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.297608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.298294 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.298743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.299207 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.487401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.502852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2fd5b969-e9ee-4056-a051-2a7a202288a4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.218372 Aug 24 14:39:18.504694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 322/587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:18 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:18.651211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:18.652055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:18.665102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.665102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.665102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.665102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.665661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.665661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.688719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:18.834214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-435ffdb4-1e32-4fe9-a146-8f56d19ba74b tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.574537 Aug 24 14:39:18.835320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 266/588] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:39:17 2022] POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments => generated 194 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:18.858874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.873839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b3418d78-11e1-4dff-a30f-5ffe2fadbf52 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.229127 Aug 24 14:39:18.879849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 323/589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:18 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:19.543389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:19.544101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:19.552934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.553542 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.554073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.554983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.555590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.556184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.698161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:19.730626 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.743931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-40fcbe18-7756-48da-8918-366a176490a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.204742 Aug 24 14:39:19.744781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 267/590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:19 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:19.917805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:19.919504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:19.929564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.930266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.930823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.931851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.932641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.933285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.961982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:20.149706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.164639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-52a4e171-fdba-43c3-baf9-7ae082c72e51 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.252546 Aug 24 14:39:20.174322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 324/591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:19 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:20.782100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:20.782707 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:20.790736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.791287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.791778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.792701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.793226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.793751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.974894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.983900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5fbb65dc-e9c7-4764-9d66-648390947a87 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.205976 Aug 24 14:39:20.984530 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 268/592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:20 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:21.193144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:21.193974 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:21.200890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.201388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.201827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.202585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.203054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.203484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.293032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9069459-afe6-441a-ada9-34cd892cb3f0", "name": "network-vif-plugged", "status": "completed", "tag": "c08f1f49-be2c-4f14-b933-c86999566efe"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:21.299632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=12 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:21.304251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.304811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.305256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.319088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] Creating event network-vif-plugged:c08f1f49-be2c-4f14-b933-c86999566efe for instance d9069459-afe6-441a-ada9-34cd892cb3f0 on hv-cinder-75670 Aug 24 14:39:21.324588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-946a0332-9b48-41d6-99fb-0cafaf906dc5 req-5fa0d63a-5ece-49f3-8935-9bc063a4ff24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035377 Aug 24 14:39:21.325208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 269/593] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:39:21.378567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:21.394146 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b5bf255c-3a82-4edf-bece-667366843f16 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.204582 Aug 24 14:39:21.395696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 325/594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:21 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:22.008615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:22.009337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:22.017157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.017657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.018136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.019771 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.020753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.020753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.180383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.189008 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8be441e1-b3cd-429d-9d54-84edb09a3639 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.185858 Aug 24 14:39:22.189621 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 270/595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:22 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:22.417173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:22.417791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:22.425103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.432072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.432072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.432072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.432072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.432672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.627848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.638430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b0b8fb30-5ae3-4b28-ba2c-f50b2f34f453 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.224960 Aug 24 14:39:22.639446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 326/596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:22 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:23.218592 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:23.221030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:23.233074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.233667 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.234181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.234918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.235407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.235812 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.415027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.417702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:23.424555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fb4b0f4d-b179-450d-bcf0-8b485c4e8029 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1367 microversion: 2.1 time: 0.213771 Aug 24 14:39:23.425885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 271/597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:23 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:23.664647 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:23.665793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:23.677768 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.680232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.680232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.680569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.681424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.682074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.868269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.877493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-513d81a4-d9fc-4865-a878-ce7dc45fb15e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.220027 Aug 24 14:39:23.878248 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 327/598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:23 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:24.448684 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.449417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.457404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.457730 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.458222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.459052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.459553 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.460105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.628372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.638479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-37dc9012-bc53-4da7-9b7e-3d14a30dc026 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1558 microversion: 2.1 time: 0.194185 Aug 24 14:39:24.639254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 272/599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:24.662212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.662848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.671672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.672461 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.672632 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.673339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.673797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.674241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.773133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5a347dbc-5156-4550-aa77-7623aa74ca2e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116392 Aug 24 14:39:24.773795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 328/600] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:39:24.902048 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.902945 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.909298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.910447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.911327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.912078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.912545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.912967 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:25.196029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:25.208336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-656ce6c7-1d2c-4634-9161-ff5130bb43f6 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.309984 Aug 24 14:39:25.229488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 273/601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:26.200431 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9069459-afe6-441a-ada9-34cd892cb3f0", "tag": "c08f1f49-be2c-4f14-b933-c86999566efe"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:26.220370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.221625 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.223190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.235668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:26.239535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:26.254820 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.254820 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.254820 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.256133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.257085 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.261018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] Creating event network-changed:c08f1f49-be2c-4f14-b933-c86999566efe for instance d9069459-afe6-441a-ada9-34cd892cb3f0 on hv-cinder-75670 Aug 24 14:39:26.266178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.274187 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-00b9869a-edae-4996-aa95-839f624554a9 req-fc6f3811-a380-45de-85be-0c6f41342f32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080472 Aug 24 14:39:26.276337 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 329/602] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:26.608925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.624005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-409e4ab8-42cc-4c53-835c-962933a45f72 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.395429 Aug 24 14:39:26.625121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 274/603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:26 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:27.663667 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:27.667002 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:27.693967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.694915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.695411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.696180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.696777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.697232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.761564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:27.761564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:27.771292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.772267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.773061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.774234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.774945 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.785190 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.803024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'flavor' on Instance uuid d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:28.044137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:28.062465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0ce281cb-03d1-4a96-8552-1c829eadc2ce tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.414692 Aug 24 14:39:28.120611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 330/604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:27 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:28.643115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a5c95b2f-2c5f-4d54-b983-fd4162b3a656 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/action" status: 200 len: 32 microversion: 2.1 time: 0.888548 Aug 24 14:39:28.643853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 275/605] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:39:27 2022] POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/action => generated 32 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:39:28.655778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:28.656748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:28.664412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:28.665227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:28.665665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:28.666422 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:28.667069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:28.667660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:28.873588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:28.873588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-33b95d27-35dd-4a3d-b63a-10f7c8376d47 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.220413 Aug 24 14:39:28.873588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 331/606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:28 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:29.091296 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:29.092054 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:29.099785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.100278 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.100839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.101562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.102036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.102467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.276967 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:29.288115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f8c6e02e-e411-4ca8-9092-8ccb182e1c26 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.201641 Aug 24 14:39:29.288725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 276/607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:29 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:29.893196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:29.894016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:29.900858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.901345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.901863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.902611 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.903063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.903508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.055068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:30.064050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bee88215-b4f6-4552-b79c-91b5d553ae86 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.174641 Aug 24 14:39:30.064839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 332/608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:29 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:30.318336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:30.318885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:30.326179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.326665 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.327156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.327849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.328300 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.328718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.544670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:30.558050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3abc7eb6-d46a-41ed-9ffa-618185e93573 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.244321 Aug 24 14:39:30.558674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 277/609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:30 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:31.087126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:31.087853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:31.094591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.095089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.095527 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.096239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.096701 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.097183 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.244994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:31.254216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-540d8cc8-4527-41f9-abe5-224d7f6ae012 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.170845 Aug 24 14:39:31.254982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 333/610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:31 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:31.580454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:31.584651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:31.588184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.588682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.589116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.589821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.590303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.590749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.854181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:31.864485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a0ae4573-4226-4d53-afac-4582d9d95861 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1756 microversion: 2.1 time: 0.287818 Aug 24 14:39:31.865183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 278/611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:31 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:32.286147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:32.286694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:32.293341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.293831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.294307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.295030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.295484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.295908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.435305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:32.444744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2a63cce4-1002-4e4c-a86a-0f555d327d38 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.163532 Aug 24 14:39:32.445575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 334/612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:32 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:32.886798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:32.887444 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:32.894991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.897501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.897501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.897501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.897501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.898063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:33.076852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:33.093871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f6994d14-1467-4c23-9f0a-7ed90e05063e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1759 microversion: 2.1 time: 0.211092 Aug 24 14:39:33.094845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 279/613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:32 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1759 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:33.466694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:33.467364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:33.475890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:33.476426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:33.476868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:33.477590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:33.478081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:33.478514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:33.629836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:33.640710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dbfa2e12-0e07-4493-8a0a-e4e63422c82d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.177999 Aug 24 14:39:33.641304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 335/614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:33 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:34.665144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:34.665832 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:34.672815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:34.673285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:34.673719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:34.674454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:34.675677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:34.676178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:34.840517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:34.849976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-aa3501c3-11f9-4b3c-a9f9-d8f5fa10b854 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.191011 Aug 24 14:39:34.850604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 280/615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:34 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:35.871529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:35.872152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:35.879569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.880104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.880548 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:35.881272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.881731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.882198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:36.031777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:36.040954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c1f9838a-3811-4f6d-9ae8-6fd5a9e71606 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.173515 Aug 24 14:39:36.041554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 336/616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:35 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:37.063933 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:37.064564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:37.073425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.073923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.074393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.075111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.075570 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.075999 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.219421 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:37.229053 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-44b3c471-5105-4176-9c64-1a93e76e3569 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.168946 Aug 24 14:39:37.229650 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 281/617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:37 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:38.251246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:38.251914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:38.259802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.260295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.260724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:38.261513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.261970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.262419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:38.411143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:38.422475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-eadc3127-9ede-4985-9632-c8a5dde819d7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.174789 Aug 24 14:39:38.423222 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 337/618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:38 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:39.448637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:39.449336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:39.452396 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:39.458748 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:39.463841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:39.463841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:39.463841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:39.463841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:39.464400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:39.616794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:39.625729 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9ec30a8b-26eb-4a6a-bb20-465af65e7a3a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.182164 Aug 24 14:39:39.626376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 282/619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:39 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:40.650071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:40.650696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:40.657550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:40.661609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:40.661609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:40.661609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:40.661609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:40.662105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:40.995129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:41.004060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b15469cc-ce1b-4e0d-9b9e-79aae50287c7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.358238 Aug 24 14:39:41.004662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 338/620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:40 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:42.029253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:42.030534 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:42.041871 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.042409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.042853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.043571 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.044034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.044507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.208536 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:42.217985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ef834f80-bf96-4ede-9ce5-77dc347bdec9 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.196364 Aug 24 14:39:42.218627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 283/621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:42 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:43.242775 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:43.243588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:43.245496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=50 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:43.251073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:43.251535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:43.251976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:43.254169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:43.254169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:43.254169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:43.463787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:43.473300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-34a0e3fc-22ed-4917-bef3-358764827fc7 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.236103 Aug 24 14:39:43.474267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 339/622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:43 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:44.502293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:44.503546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:44.511398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.511888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.512317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.513011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.513465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.513887 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.735753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:44.744944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9d36f76e-692f-4e0a-93d7-7e3ca1a77a5f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.246571 Aug 24 14:39:44.745590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 284/623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:44 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:45.207882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:45.208444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:45.215472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.215962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.216434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.217162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.217618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.218071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.250875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:45.255828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-73607e0a-7d70-47a3-bf33-1e6bb7ae2970 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments/e9962e3e-767e-4fd9-a3e5-20a4db1795cf" status: 200 len: 194 microversion: 2.20 time: 0.052407 Aug 24 14:39:45.256454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 340/624] 10.222.0.49 () {60 vars in 1454 bytes} [Wed Aug 24 14:39:45 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments/e9962e3e-767e-4fd9-a3e5-20a4db1795cf => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:45.334734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:45.335235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:45.341375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.341872 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.342342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.343050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.343500 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.343928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.437673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lazy-loading 'services' on Instance uuid 3df69832-0c15-4371-b4cd-a5517f6945b3 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:45.616663 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:45.746365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-73e6e234-214b-4d98-8f86-71b0a92c8cf1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments/e9962e3e-767e-4fd9-a3e5-20a4db1795cf" status: 202 len: 0 microversion: 2.20 time: 0.415745 Aug 24 14:39:45.746919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 285/625] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 24 14:39:45 2022] DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments/e9962e3e-767e-4fd9-a3e5-20a4db1795cf => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:39:45.756925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:45.759633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:45.766608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.767111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.767558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.768313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.769648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.769648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.770633 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:45.771351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:45.778324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.778816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.779408 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.780140 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.780597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.781019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.804422 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b193b5ea-0604-4e9e-a5c4-8fec3facfebf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052516 Aug 24 14:39:45.805302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 341/626] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 14:39:45 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:39:45.950260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:45.960655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-af4193cb-cf69-4b02-8d24-1a5f19d20885 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.195444 Aug 24 14:39:45.961376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 286/627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:45 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:46.821399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:46.825209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:46.835753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:46.836258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:46.836705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:46.837445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:46.837907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:46.838366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:46.874190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-48b2693f-7c9d-4884-b603-3ecc23c4f526 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060621 Aug 24 14:39:46.874807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 342/628] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 14:39:46 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:46.991141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:46.991953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:47.002571 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.003408 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.004026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.004896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.005664 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.006254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.184463 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:47.198097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-24abc31a-8f86-4461-ae1c-05c77029d635 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.213569 Aug 24 14:39:47.198959 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 287/629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:46 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:47.887852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:47.890071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:47.897737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.898394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.898906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.899730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.900241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.900724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.934458 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0b06b1d4-58f4-4e0a-9c2c-7636488857d3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051333 Aug 24 14:39:47.935313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 343/630] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 14:39:47 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:48.009494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:48.015159 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:48.016958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.017458 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.017907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.018930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.019448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.019981 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.048591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:39:48.225735 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:48.226643 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:48.234664 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.235305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.236016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.236876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.238932 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.239133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.415175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:48.416296 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7af842a9-6125-4522-a3fb-5cbd72557214 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 204 len: 0 microversion: 2.20 time: 0.410901 Aug 24 14:39:48.416927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 288/631] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 14:39:48 2022] DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:39:48.427445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:48.428222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:48.433659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-17752f5c-642f-4c44-bcb4-995fc32b8ea6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.214227 Aug 24 14:39:48.435086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 344/632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:48 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:48.435211 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.435760 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.436293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.437191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.437675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.438177 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.602364 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:48.611084 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:48.613582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:48.614857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bebf2d09-f6f5-469a-bded-83a863f2fe81 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.193206 Aug 24 14:39:48.615437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 289/633] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:48 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:49.469594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:49.470365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:49.479347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.479890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.480381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:49.481552 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.482126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.482616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:49.632847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:49.638436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:49.639239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:49.642033 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8073711b-03c3-427c-bab9-36db6a3aae59 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.176406 Aug 24 14:39:49.642657 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 345/634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:49 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:49.647313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.647805 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.648245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:49.648965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.649425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.649853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:49.805457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:49.814477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:49.816028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:49.817241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cf3a9856-cd53-466d-b4b3-11902102e858 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.183029 Aug 24 14:39:49.817863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 290/635] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:49 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:50.669096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:50.670212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:50.682378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:50.683266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:50.684038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:50.685328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:50.686214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:50.686998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:50.842585 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:50.843611 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:50.851186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:50.857833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:50.859925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:50.860376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:50.861140 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:50.861607 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:50.862200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:50.865300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cc785043-6f4b-454e-b7b3-36b4d2436e7c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.203656 Aug 24 14:39:50.866391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 346/636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:50 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:51.115976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:51.124938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:51.126605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:51.128486 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c30b632e-619c-440d-b6e4-ec14b1b6de08 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1721 microversion: 2.20 time: 0.291101 Aug 24 14:39:51.129083 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 291/637] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:50 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:51.895644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:51.896830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:51.914326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:51.915052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:51.915691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:51.916589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:51.917046 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:51.917477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:52.089074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:52.098812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-00378525-9c2c-464a-864c-739baa05684d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1735 microversion: 2.1 time: 0.211614 Aug 24 14:39:52.113451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 347/638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:51 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:52.154218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:52.155073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:52.163451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:52.163942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:52.164378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:52.166425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:52.166425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:52.166425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:52.243410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:52.257028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:52.260946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:52.262430 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-349b165c-5707-4e21-8ad3-20189341e8b5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1654 microversion: 2.20 time: 0.113087 Aug 24 14:39:52.263319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 292/639] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:52 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1654 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:52.505059 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df69832-0c15-4371-b4cd-a5517f6945b3", "name": "network-vif-deleted", "tag": "195c4f73-569c-4ec8-9387-00f0ff4cabda"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:52.520317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:52.521010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:52.521727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:52.582397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] Creating event network-vif-deleted:195c4f73-569c-4ec8-9387-00f0ff4cabda for instance 3df69832-0c15-4371-b4cd-a5517f6945b3 on hv-cinder-75670 Aug 24 14:39:52.582397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-5a7decb2-7693-430e-a9af-3f06f9f32ac3 req-5a6142ad-e4bd-4a94-b1fc-29c03c039a85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045714 Aug 24 14:39:52.582397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 348/640] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:39:53.123888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:53.124561 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:53.132353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.133257 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.133797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.134663 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.135245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.135759 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.304977 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:53.305685 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:53.312589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.313084 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.313523 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.314276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.314738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.315808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.327510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:53.337754 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-80119019-dc16-4c80-95e6-a355251b4308 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1715 microversion: 2.1 time: 0.218683 Aug 24 14:39:53.338659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 293/641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:53 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1715 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:53.359505 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.360231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.360771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.361273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lazy-loading 'fault' on Instance uuid 3df69832-0c15-4371-b4cd-a5517f6945b3 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:53.434979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:53.445689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:53.447427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:53.448884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b1008ea1-5b44-4fb8-b647-726bf531731f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 200 len: 1370 microversion: 2.20 time: 0.149859 Aug 24 14:39:53.449543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 349/642] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:53 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:53.523194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:53.531308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:53.532205 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.532984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.534867 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.535881 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.536451 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.537004 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.655352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] HTTP exception thrown: Cannot 'detach_volume' instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b while it is in vm_state rescued Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Request method failure captured: Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments/2460ff86-d072-4236-995e-22cb50cbd516 HTTP/1.1 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcQU4fU91ml_MReRF7S67gknM-h3d06v2-hyoznVH7NxKdVNgWsUroE1sdodqWiiuMg2R1WK87YUsBH30QzQiI93XSWGQ2aIk3c1iKdd09teSLTav9AQTntxqITLXHxhRMLWxpswlZFaAH5bxfdHpfKKqGqFTBK15wdWle_iFWmOZY Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:39:53.664821 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7af0efe201074713a9076e220de8ea61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7af0efe201074713a9076e220de8ea61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 3570472f8c2b42b480ec1d1220414bec Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:39:53.667246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Cannot 'detach_volume' instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b while it is in vm_state rescued Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'server_id': 'd4e1420d-7ce5-4ab5-9d18-0fe7dd50125b', 'id': '2460ff86-d072-4236-995e-22cb50cbd516'} Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:53.668956 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b while it is in vm_state rescued Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b while it is in vm_state rescued Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:39:53.671971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Returning 409 to user: Cannot 'detach_volume' instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b while it is in vm_state rescued {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:53.674116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-83878f6b-ba3c-4cfe-ba2e-27cf297a4dce tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments/2460ff86-d072-4236-995e-22cb50cbd516" status: 409 len: 152 microversion: 2.1 time: 0.140667 Aug 24 14:39:53.674116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 294/643] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:39:53 2022] DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments/2460ff86-d072-4236-995e-22cb50cbd516 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:39:53.675602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:53.676299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:53.687258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.688065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.688636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.689671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:53.691115 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:53.691628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.046317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c87598c3-cd1e-40b3-90ee-7299ab2d80ea tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/action" status: 202 len: 0 microversion: 2.1 time: 0.378372 Aug 24 14:39:54.047386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 350/644] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:39:53 2022] POST /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:39:54.057526 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:54.058192 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:54.067410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.067911 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.068365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.069082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.069535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.069958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.299412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:54.311947 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-75af6f99-c38e-4b2a-ae08-a8bd95b9eba4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1723 microversion: 2.1 time: 0.258925 Aug 24 14:39:54.312744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 295/645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:54 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:54.478244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:54.479139 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:54.486436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.486964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.488829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.489832 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.490089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.490541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.507446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 HTTP/1.1 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:39:54.509438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:39:54.516138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '3df69832-0c15-4371-b4cd-a5517f6945b3'} Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:54.517719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:39:54.520687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:39:54.523938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:54.523938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e1745c4a-3476-4503-8d20-742f19f168c9 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 404 len: 111 microversion: 2.20 time: 0.039389 Aug 24 14:39:54.523938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 351/646] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:54 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:39:54.528341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ff9568e0-3b61-40d6-95de-06a512c4b007 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '.version_select at 0x7f8a8c0b0af0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:54.669129 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ff9568e0-3b61-40d6-95de-06a512c4b007 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597025216" status: 204 len: 0 microversion: 2.20 time: 0.148944 Aug 24 14:39:54.670303 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 296/647] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 14:39:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597025216 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:39:55.334992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:55.335612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:55.341843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:55.342462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:55.342900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:55.343598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:55.344050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:55.344471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:55.527724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:55.537194 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ebd37292-79cb-472b-a8e9-f142bb54a473 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1723 microversion: 2.1 time: 0.206146 Aug 24 14:39:55.537789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 352/648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:55 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:55.745205 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0352f509-04ef-497a-8609-bcdb30a2a83a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: .version_select at 0x7f8a8c09ab80>, body: {"keypair": {"name": "tempest-keypair-267082290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcXqkUERTduObUZ3Gw79UOOVJONeYTLDW6E+f8iDzAhBuifo4LA0ZEt26GhDR7l5/gsUkin9IkZwH9t+XwouQ9amuoqvJiAKQkxF1sc0bzaIwl3wcDSpGSZOGelGd1vOA=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:55.777382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-0352f509-04ef-497a-8609-bcdb30a2a83a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for project 5981da6161ac4717a5b433c31188da53. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:39:55.785025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-0352f509-04ef-497a-8609-bcdb30a2a83a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for user c888090dd9f246a79c6be54faf480ed9 and project 5981da6161ac4717a5b433c31188da53. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:39:55.903427 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0352f509-04ef-497a-8609-bcdb30a2a83a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.166410 Aug 24 14:39:55.904090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 297/649] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 14:39:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:56.565689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:56.565689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:56.568813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:56.569301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:56.569739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:56.570470 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:56.570926 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:56.571347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:56.766877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:56.781467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e49d1eb4-52a6-49d3-964f-7e212cc0e663 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1723 microversion: 2.1 time: 0.224223 Aug 24 14:39:56.782531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 353/650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:56 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:57.993282 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:57.994495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:58.006430 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.007326 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.008393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.009958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.010803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.011543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.233189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:58.243756 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3a4b1302-e3a3-42b6-94d3-1e86fa2af4dd tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1729 microversion: 2.1 time: 0.430178 Aug 24 14:39:58.244423 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 298/651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:57 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1729 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:58.266447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:58.267074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:58.275167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.275667 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.276119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.276838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.277300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.277730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.365707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b20c9f84-7dd2-4782-ad5c-55be1c1ee0c0 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103123 Aug 24 14:39:58.370527 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 354/652] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:39:58 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:59.194110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-872746106", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21aeb1d4-5bbd-47dc-90e4-adede63fdee0"}], "security_groups": [{"name": "tempest-securitygroup--1669033601"}], "key_name": "tempest-keypair-267082290", "user_data": "}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:59.405742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] validate_networks() for [('21aeb1d4-5bbd-47dc-90e4-adede63fdee0', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:39:59.858300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:59.861594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:59.869298 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.869801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.870277 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:59.871014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.871488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.871917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:59.905716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b0d6c2f8-0c35-48a5-b866-75da8fc415e4 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054212 Aug 24 14:39:59.906375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 355/653] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:39:59 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 14:39:59.978192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:59.978699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:59.985129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.985626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.986101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:59.987004 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.988028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.988028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.015791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:00.059526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:00.127256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:40:00.129217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 (ip 10.222.0.49) !!! Aug 24 14:40:00.140249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:00.140826 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:00.141477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:00.142437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:00.143194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:00.166481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.171293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.171293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.171293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.171293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.171677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.204924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for project 5981da6161ac4717a5b433c31188da53. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:00.211069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Getting quotas for user c888090dd9f246a79c6be54faf480ed9 and project 5981da6161ac4717a5b433c31188da53. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:00.226437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:00.229201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:00.439192 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-de88059c-f99a-4b66-a109-7da2b533fc71 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.250339 Aug 24 14:40:00.442912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 299/654] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 14:39:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 14:40:00.452442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:00.471038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-21ea1929-1810-4196-a17f-4b8d4aaba341 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 204 len: 0 microversion: 2.1 time: 0.495872 Aug 24 14:40:00.474333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 356/655] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:39:59 2022] DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:40:00.481247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.482186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.482959 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.484536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:00.493019 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:00.514813 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] Creating event network-changed:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:40:00.528851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-76867fd2-a755-4c09-9ffe-6fafcac391a7 req-9087d68c-0198-4e4b-8e5b-0a740224710a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083444 Aug 24 14:40:00.529964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 300/656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:00.544920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:00.546247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:00.565014 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.567055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.567806 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.569090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.569938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.570750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.610475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:00.620947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:00.622510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:00.624058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8e311620-7659-4f9d-b495-1eeae11e1d98 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1280 microversion: 2.20 time: 0.146502 Aug 24 14:40:00.624758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 357/657] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:00 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:00.798661 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:00.816105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6692c041-1d7c-42b5-8c8e-615e7e48887b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1672 microversion: 2.1 time: 0.283046 Aug 24 14:40:00.817137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 301/658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:00 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1672 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:01.647822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:01.648481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:01.655864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.656370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.656842 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:01.657569 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.658074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.658515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:01.732659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:01.742769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:01.744349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:01.745492 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-50af8df4-0c7c-449e-b117-d33b51fe2baa tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1284 microversion: 2.20 time: 0.102605 Aug 24 14:40:01.746096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 358/659] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:01 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:01.972407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:01.973201 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:01.980250 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.980752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.981208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:01.981935 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.982433 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.982863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:02.132291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:02.140856 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3aceda16-da57-4905-be00-b2ba77b7d407 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1672 microversion: 2.1 time: 0.292981 Aug 24 14:40:02.141456 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 302/660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:01 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1672 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:02.564770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:02.580995 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:02.581963 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:02.582738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:02.604542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] Creating event network-changed:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:40:02.614545 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-17bb7839-f618-4cda-911a-74be2c9618f9 req-72b6479c-1ea4-4dcc-aa72-fd94d441fb61 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056238 Aug 24 14:40:02.615296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 359/661] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:02.771790 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:02.773023 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:02.781215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:02.781972 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:02.782675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:02.783539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:02.784225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:02.784844 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:02.896763 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:02.906916 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:02.908586 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:02.910597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f839036a-0daa-4c6b-90d1-66c469ee456b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1276 microversion: 2.20 time: 0.145491 Aug 24 14:40:02.911215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 303/662] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:02 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:03.165208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:03.167615 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:03.176920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.177892 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.178434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.179285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.179862 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.180403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.350805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:03.360299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4bdfc081-d3d2-4c1b-a2c8-26cd617c9136 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1672 microversion: 2.1 time: 0.200086 Aug 24 14:40:03.360923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 360/663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:03 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:03.944492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:03.945252 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:03.952047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.952427 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.953100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.953828 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.954348 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.954781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.959113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:04.342106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:04.355898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:04.357784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:04.359794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5437ca26-6f83-4f7d-bb67-0166a893fe41 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1340 microversion: 2.20 time: 0.429061 Aug 24 14:40:04.360613 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 304/664] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:03 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1340 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:04.406746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:04.407704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:04.424078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:04.426078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:04.434650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:04.436140 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:04.436994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:04.437863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:04.561689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:04.575958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1c842216-bbb0-4c9b-af08-c2857029268c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1604 microversion: 2.1 time: 0.176951 Aug 24 14:40:04.582496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 361/665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:04 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:05.020222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a79bb8-4962-4c32-bafd-b5759bea2607", "name": "network-vif-deleted", "tag": "064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:05.040566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.041599 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.042907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.061209 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] Creating event network-vif-deleted:064e3f0b-8893-4a9a-9c4f-2fe9b9ddc874 for instance c0a79bb8-4962-4c32-bafd-b5759bea2607 on hv-cinder-75670 Aug 24 14:40:05.071339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-37502799-8e08-4430-ac6b-39871ff027ec req-45d9810a-4dd7-4c4d-935b-1781f2ac5231 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064259 Aug 24 14:40:05.073546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 305/666] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:05.411812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:05.413158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:05.420994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.425486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.425486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.425486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.425486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.426256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.495317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:05.505348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:05.507699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:05.509116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-08f25fef-3bdc-44ae-b1c6-ec38c8387a92 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1338 microversion: 2.20 time: 0.102196 Aug 24 14:40:05.510318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 362/667] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:05 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:40:05.620083 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:05.621261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:05.635125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.636367 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.637481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.638970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.640114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.640984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.711934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.713251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.714437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.715645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lazy-loading 'fault' on Instance uuid c0a79bb8-4962-4c32-bafd-b5759bea2607 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:05.802605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:05.817919 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cce39f44-eb7e-4cda-8931-01e1a1db0db0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 200 len: 1326 microversion: 2.1 time: 0.206102 Aug 24 14:40:05.819121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 306/668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:05 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 1326 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:06.557199 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:06.558509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:06.570817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.571684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.572547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.573913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.575431 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.576151 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.779062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:06.789355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:06.790924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:06.792186 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6debbbb2-469d-4a4f-8efe-0967650d181c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.243695 Aug 24 14:40:06.792783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 363/669] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:06 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:06.870383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:06.871572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:06.884400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.885365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.886299 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.887731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.888691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.889603 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.908059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 HTTP/1.1 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:40:06.910753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:40:06.917200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'c0a79bb8-4962-4c32-bafd-b5759bea2607'} Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:06.918210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:40:06.919691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:06.920977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:06.920977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e5b794e7-75f1-423a-8564-a6c12d4e72d8 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 404 len: 111 microversion: 2.1 time: 0.054537 Aug 24 14:40:06.920977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 307/670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:06 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:06.925957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c4830ae9-b4ad-4818-b141-23e6fc6d8fea tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '.version_select at 0x7f8a8c18ef70>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:07.046278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c4830ae9-b4ad-4818-b141-23e6fc6d8fea tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684012220" status: 202 len: 0 microversion: 2.1 time: 0.127806 Aug 24 14:40:07.051328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 364/671] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 14:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684012220 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:07.248691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:07.266758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:07.267623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:07.268917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:07.290738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] Creating event network-changed:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:40:07.296944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-6c5c8e28-b209-466f-ab90-b2c3903a1482 req-6417db74-b952-4705-bea7-6f8c6fc10c4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054255 Aug 24 14:40:07.297779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 308/672] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:07.823189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:07.825316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:07.842689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:07.842689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:07.842689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:07.842689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:07.843416 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:07.843416 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:08.073278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:08.084329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:08.086827 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:08.088138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-426bf954-ad3b-4e1c-a11b-014345316fe0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.274400 Aug 24 14:40:08.088796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 365/673] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:07 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:08.216443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-134a6afb-7869-4753-8a47-febfdd991c6c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: .version_select at 0x7f8a8c0b0ee0>, body: {"keypair": {"name": "tempest-keypair-824111189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSN/BDpc/zbriLr2NQ8xtj66JGwQ3NIsqGDK6f8SAPdU9VxB+LAp0N9E110BRSF6dXW/vsR7kMUlNqfPGzLT02lIkr+uKtJEwemj/SzzKbSy5zpHYkWQUIEHjEEDLiU2g=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:08.235495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-134a6afb-7869-4753-8a47-febfdd991c6c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:08.241428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-134a6afb-7869-4753-8a47-febfdd991c6c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for user 7b946ecd87434ad6a00890887d234281 and project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:08.260560 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:08.342772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-134a6afb-7869-4753-8a47-febfdd991c6c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131441 Aug 24 14:40:08.344142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 309/674] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:40:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:09.126649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:09.127819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:09.135613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:09.136152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:09.136597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:09.137322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:09.137788 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:09.138359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:09.304233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:09.313629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:09.315184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:09.316349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-13642922-463d-4878-b55c-b214204a8000 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.193693 Aug 24 14:40:09.316923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 366/675] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:09 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:10.336268 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:10.340507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:10.341247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:10.350374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.352426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.352426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.352426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.352426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.352973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.537125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:10.548439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:10.551130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:10.552620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0eb811f7-cb4c-4227-bd60-9626fead88cc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.217513 Aug 24 14:40:10.553275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 310/676] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:10 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:11.313510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-694792075", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f1fda62-4842-49d3-9357-99396d1dc4a1"}], "security_groups": [{"name": "tempest-securitygroup--1494762531"}], "key_name": "tempest-keypair-824111189", "user_data": "}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:11.332637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:11.463361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] validate_networks() for [('9f1fda62-4842-49d3-9357-99396d1dc4a1', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:11.682849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:11.682849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:11.687766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:11.688578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:11.689156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:11.690698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:11.691324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:11.691944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:11.722564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b5e20b43-5206-4d6e-bb0b-1f9110653e92 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/ips" status: 200 len: 150 microversion: 2.1 time: 0.237064 Aug 24 14:40:11.723253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 311/677] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:40:11 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/ips => generated 150 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:11.728369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:11.729260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:11.737632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:11.738157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:11.738634 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:11.739355 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:11.739815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:11.740341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:11.937385 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:11.948010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:11.949749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:11.951262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b1ca926e-866c-4fa0-a353-e3590f911618 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.226848 Aug 24 14:40:11.951845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 312/678] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:11 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:12.083354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:12.083894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:12.084529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:12.085048 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:12.085561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:12.096951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:12.097512 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:12.098084 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:12.099075 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:12.099665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:12.100196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:12.121662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:12.126368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Getting quotas for user 7b946ecd87434ad6a00890887d234281 and project d2bc03440f454c15abb4aab9bf6e2374. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:12.140706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:12.143900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:12.289750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b780735d-7378-4dd8-b8c7-874de2cdcc09 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984563 Aug 24 14:40:12.291270 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 367/679] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:40:12.311323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2b283181-f878-4f6c-8861-228253ccd70c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:12.312952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2b283181-f878-4f6c-8861-228253ccd70c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:12.380277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2b283181-f878-4f6c-8861-228253ccd70c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:12.392347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2b283181-f878-4f6c-8861-228253ccd70c tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1236 microversion: 2.1 time: 0.088543 Aug 24 14:40:12.394608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 313/680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:12 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:12.977283 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:12.977931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:12.985413 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:12.986264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:12.987400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:12.988300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:12.988843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:12.989287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:13.145973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:13.155991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:13.157639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:13.159817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6ed17154-1025-4152-ba04-ab4070b849ad tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.188127 Aug 24 14:40:13.160233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 368/681] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:12 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:40:13.418664 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b1e0d51a-f891-4f72-b5af-d608622ff589 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:13.420088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b1e0d51a-f891-4f72-b5af-d608622ff589 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:13.499063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b1e0d51a-f891-4f72-b5af-d608622ff589 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:13.512444 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b1e0d51a-f891-4f72-b5af-d608622ff589 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1236 microversion: 2.1 time: 0.097525 Aug 24 14:40:13.513741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 314/682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:13 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:13.532703 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "name": "network-vif-plugged", "status": "completed", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:13.544967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:13.554276 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:13.555194 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:13.555945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:13.581055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] Creating event network-vif-plugged:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:40:13.589874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-61f939e8-d6b4-47ba-ba62-3edfdee19c97 req-cd377f9b-dcfe-4cc1-902a-bfab2f8d7d19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063914 Aug 24 14:40:13.590953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 369/683] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:13.615424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:13.618407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:13.626019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:13.626519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:13.627032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:13.628420 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:13.628889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:13.629429 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.185475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:14.186224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:14.193119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.193602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.194098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.195088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.195448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.195875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.369794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:14.386674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:14.389900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:14.392191 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fc819682-c63c-41fa-be59-73c606fba545 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.211969 Aug 24 14:40:14.394810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 370/684] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:14 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:14.537401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:14.538039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:14.545198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.545959 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.546716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.547179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.547648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.628990 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:14.631299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ffe239e6-878c-430a-9a15-0da71093fe42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1232 microversion: 2.1 time: 0.098615 Aug 24 14:40:14.632043 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 371/685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:14 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1232 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:14.980912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-52342d30-cd8a-4936-b8ad-8ceb19ce216a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.369932 Aug 24 14:40:14.981491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 315/686] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:40:13 2022] POST /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments => generated 194 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:15.423867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:15.425517 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:15.434138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:15.434823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:15.435411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:15.436303 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:15.436851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:15.437362 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:15.600741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:15.615229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:15.621204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:15.621204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-52461caa-905b-42f9-9dd8-34dfa2dc32bf tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1406 microversion: 2.20 time: 0.198284 Aug 24 14:40:15.621204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 372/687] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:15 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:15.659152 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:15.660076 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:15.667581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:15.668086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:15.668522 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:15.669243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:15.669704 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:15.670174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:15.758705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:15.773742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5bbb6107-dca3-4407-80af-539e9c4f3925 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1288 microversion: 2.1 time: 0.118999 Aug 24 14:40:15.774873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 316/688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:15 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:16.647850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:16.648975 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:16.661076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.661780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.662355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.663565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.664130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.664786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.810151 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:16.811066 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:16.822094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.825604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.825604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.825604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.825604 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.826395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.857409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:16.870529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:16.872247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:16.873553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-12ac3b43-240c-46dc-80a9-798a6fc2fcf0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1599 microversion: 2.20 time: 0.234939 Aug 24 14:40:16.874559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 373/689] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:16 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1599 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:40:16.906636 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:16.907266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:16.908130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:16.917104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a7f3c1d5-69f6-48d4-a89a-a18695a2c6b7 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1294 microversion: 2.1 time: 0.112530 Aug 24 14:40:16.917917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 317/690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:16 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:16.921090 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.921932 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.922644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.923629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.924971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.929718 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:17.071968 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3c531f43-5037-4203-b809-3a377d28da90 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.172483 Aug 24 14:40:17.073215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 374/691] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 14:40:16 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:40:17.959105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:17.960487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:17.973804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:17.975519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:17.976924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:17.978485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:17.979731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:17.980843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:18.448073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:18.458906 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-64c1537f-db4c-4792-ace6-9c067ae3785e tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.506880 Aug 24 14:40:18.459717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 318/692] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:17 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:19.106772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:19.124158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:19.125112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:19.131984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:19.149684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] Creating event network-changed:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:40:19.159209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-c984d1b7-b3ba-489c-b19a-cc85bc4ff2fc req-71bc29e7-2a88-40c2-bfca-9fc589100c0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060129 Aug 24 14:40:19.160387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 375/693] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:19.481158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:19.481979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:19.492293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:19.492847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:19.493883 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:19.494787 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:19.495269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:19.495698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:19.848267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:19.863092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2a1b3d1e-383d-40e9-b057-49b82d6844dd tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.384979 Aug 24 14:40:19.864178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 319/694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:19 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:20.886619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:20.887366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:20.894898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:20.895392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:20.895847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:20.896557 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:20.897020 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:20.897444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:21.061871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:21.071374 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9e3ffdda-69ca-4b1c-accc-57bbe7cb22aa tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.189701 Aug 24 14:40:21.072152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 376/695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:20 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:21.177600 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dca5a2a-236a-433b-af27-004eab6505de", "tag": "587f3fb6-6858-4261-b25e-e2689a06d71e"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:21.188724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:21.189217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:21.190717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:21.204029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] Creating event network-changed:587f3fb6-6858-4261-b25e-e2689a06d71e for instance 1dca5a2a-236a-433b-af27-004eab6505de on hv-cinder-75670 Aug 24 14:40:21.213434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-55221cb7-e622-47ad-837e-c2f216ac1821 req-89a1d6ce-ec06-4eac-a045-1ce4ea8ecfef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037581 Aug 24 14:40:21.213434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 320/696] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:22.093478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:22.094177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:22.101064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:22.101532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:22.101976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:22.102721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:22.103227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:22.103658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:22.108467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:22.138771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=6 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:22.270735 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:22.274371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:22.279135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-55b7d40b-fd76-4164-99a3-686097137d85 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.189670 Aug 24 14:40:22.279728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 377/697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:22 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:23.303372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:23.304333 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:23.312585 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.313082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.313515 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.314286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.315524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.315958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.505817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:23.511088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=18 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:23.520792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3c695213-386c-490e-8ccf-3391c29e5e5d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.222942 Aug 24 14:40:23.528288 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 321/698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:23 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:23.828854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:23.831959 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:23.839266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.839755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.840191 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.840951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.841405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.841828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.940897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: POST /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments HTTP/1.1 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 74 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:40:23.942911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {"volumeAttachment": {"volumeId": "8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5"}} Aug 24 14:40:23.945343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'server_id': 'd9069459-afe6-441a-ada9-34cd892cb3f0', 'body': {'volumeAttachment': {'volumeId': '8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5'}}} Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:23.953547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:23.957071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 400 to user: Invalid volume: volume 8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 is already attached to instances: d9069459-afe6-441a-ada9-34cd892cb3f0 {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-98fb54d7-f17f-4f33-8692-d0362eb7688a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120746 Aug 24 14:40:23.959741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 378/699] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:40:23 2022] POST /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:40:24.033048 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:24.035096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:24.042225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.042814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.043354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.044156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.044685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.045191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.163103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'services' on Instance uuid d9069459-afe6-441a-ada9-34cd892cb3f0 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:24.420198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-16f9c981-fd96-4b27-8bcd-80cde8b95b2f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments/8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5" status: 202 len: 0 microversion: 2.1 time: 0.392093 Aug 24 14:40:24.421330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 322/700] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:40:24 2022] DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments/8cfd8b5a-36ba-4cb1-85a3-a063b5a809e5 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:24.434471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:24.438799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:24.449739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.450335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.450824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.451607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.452116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.452590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.500232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3b0cd001-b87a-4fa2-bd02-5d423a708c97 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073215 Aug 24 14:40:24.501292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 379/701] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:24 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:24.548341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:24.550065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:24.562701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.563773 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.564499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.566536 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.567109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.567590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.002706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:25.013187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d89a5e3f-1a76-40f4-8e85-d54aa48e9163 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.471684 Aug 24 14:40:25.013984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 323/702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:24 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:25.514052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:25.516457 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:25.527489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:25.528058 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:25.528638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.529425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:25.529938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:25.530463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.598430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9da374da-2807-40f4-bacd-f17ab6b4cded tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088631 Aug 24 14:40:25.599137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 380/703] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:25 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:25.693294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca5a2a-236a-433b-af27-004eab6505de", "name": "network-vif-plugged", "status": "completed", "tag": "587f3fb6-6858-4261-b25e-e2689a06d71e"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:25.704254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:25.704751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:25.705262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.718281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] Creating event network-vif-plugged:587f3fb6-6858-4261-b25e-e2689a06d71e for instance 1dca5a2a-236a-433b-af27-004eab6505de on hv-cinder-75670 Aug 24 14:40:25.724516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-2818e428-c3d4-48c2-b30b-67c6de4b905c req-a53b9ea9-9af9-4e95-9a8f-4b9480380465 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035874 Aug 24 14:40:25.725195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 324/704] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:26.038621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:26.039153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:26.045870 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.046299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.046744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.047465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.047924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.048352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.201810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:26.211805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b5cde1ce-6c06-4127-ac2e-48d43c129f44 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.177172 Aug 24 14:40:26.212461 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 381/705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:26 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:26.611928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:26.614317 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:26.620808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.621217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.621647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.622392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.622932 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.623255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.625978 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:26.659165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f572dce1-6d4e-4071-bb47-c0683a3c9f2b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051009 Aug 24 14:40:26.659754 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 325/706] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:26 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:40:26.732383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:26.732943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:26.740556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.741078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.741507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.742249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.742708 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.743124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.771970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:27.203823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b7583096-2904-4407-83ef-ca4a3136718c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 204 len: 0 microversion: 2.1 time: 0.474935 Aug 24 14:40:27.204422 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 382/707] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:40:26 2022] DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:27.213125 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:27.213846 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:27.221126 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.221622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.222096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:27.222812 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.223273 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.223921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:27.249807 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:27.254563 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:27.259235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.259823 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.260326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:27.261190 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.261772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.262347 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:27.397843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:27.413766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-767f9178-99b2-4c16-b9bf-2901f544d117 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1682 microversion: 2.1 time: 0.204448 Aug 24 14:40:27.414994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 326/708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:27 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:27.446746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:27.457216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c20125dd-6bd0-4658-9309-df56a6576b3a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.213150 Aug 24 14:40:27.457724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 383/709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:27 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:28.448970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:28.450099 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:28.457649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:28.458315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:28.458868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:28.459671 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:28.460184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:28.460661 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:28.483918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:28.485009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:28.496565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:28.497365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:28.498176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:28.499348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:28.500129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:28.500853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:28.658436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:28.669374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2b35f891-88a3-4225-8f86-db40d2c6342a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1682 microversion: 2.1 time: 0.224599 Aug 24 14:40:28.670172 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 327/710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:28 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:28.695477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:28.704175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ea52523b-70c2-40e2-a484-80beb4816390 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1362 microversion: 2.1 time: 0.227181 Aug 24 14:40:28.714742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 384/711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:28 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:29.697123 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:29.698321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:29.710403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.711290 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.712110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.713378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.714269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.715041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.742036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:29.744782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:29.758629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.759744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.760646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.761975 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.762931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.763762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.950414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:29.961472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f43dd808-372f-40d6-ac2c-4a7d7004981a tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1548 microversion: 2.1 time: 0.229068 Aug 24 14:40:29.962266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 385/712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:29 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:29.994607 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:30.003107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:30.004478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:30.012628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c9470e4e-8b86-41a9-bb55-97a4ecf7b91a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1682 microversion: 2.1 time: 0.322982 Aug 24 14:40:30.036742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:30.036989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 328/713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:29 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:30.037176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:30.037176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:30.037176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:30.037176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:30.037776 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:30.157638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b2bff1b8-0c2b-4bb0-8eab-6a0ab5893fc6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162516 Aug 24 14:40:30.158784 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 386/714] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:40:29 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:30.860229 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9069459-afe6-441a-ada9-34cd892cb3f0", "name": "network-vif-deleted", "tag": "c08f1f49-be2c-4f14-b933-c86999566efe"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:30.871892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:30.872421 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:30.872855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:30.887283 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] Creating event network-vif-deleted:c08f1f49-be2c-4f14-b933-c86999566efe for instance d9069459-afe6-441a-ada9-34cd892cb3f0 on hv-cinder-75670 Aug 24 14:40:30.894340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-80b80985-160c-4d0a-8425-35f7ad5a3bc7 req-f47d1d21-5eb2-4448-b943-d4c7f7a5a9d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179229 Aug 24 14:40:30.895266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 329/715] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:31.074474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:31.075665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:31.087988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:31.088842 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:31.089720 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:31.090939 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:31.092079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:31.092844 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:31.233765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:31.251712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fee47979-5c74-4060-b40d-1a62e833c2ce tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 200 len: 1326 microversion: 2.1 time: 0.186436 Aug 24 14:40:31.255644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 387/716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:31 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:31.960050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dca5a2a-236a-433b-af27-004eab6505de", "tag": "587f3fb6-6858-4261-b25e-e2689a06d71e"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:31.978675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:31.979876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:31.980816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.003284 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] Creating event network-changed:587f3fb6-6858-4261-b25e-e2689a06d71e for instance 1dca5a2a-236a-433b-af27-004eab6505de on hv-cinder-75670 Aug 24 14:40:32.012798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-857f1abf-8672-4dbb-bc4e-ebd1271290be req-99c9ab28-38ea-47ea-b561-0ba2526b1249 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149717 Aug 24 14:40:32.014781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 330/717] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:32.294573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:32.295624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:32.308634 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.309426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.310177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.311694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.312526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.313256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.340280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 HTTP/1.1 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:40:32.344015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:40:32.347291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'd9069459-afe6-441a-ada9-34cd892cb3f0'} Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:32.349168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:40:32.351654 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:32.355534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:32.357027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-912dd78d-eee5-41e8-a1de-417ba3b99c75 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 404 len: 111 microversion: 2.1 time: 0.069120 Aug 24 14:40:32.362652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 388/718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:32 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:32.369737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3011a65c-f7b4-46d5-b1b2-af26cab77889 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '.version_select at 0x7f8a8c053040>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:32.492359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3011a65c-f7b4-46d5-b1b2-af26cab77889 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668698881" status: 202 len: 0 microversion: 2.1 time: 0.126895 Aug 24 14:40:32.494015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 331/719] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 14:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668698881 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:32.672221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:32.674858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:32.688281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.690949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.692075 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.694164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.696206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.698253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.947197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'services' on Instance uuid d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:33.342364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a9076b99-eae3-4c34-81d9-8443eff17437 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments/2460ff86-d072-4236-995e-22cb50cbd516" status: 202 len: 0 microversion: 2.1 time: 0.680235 Aug 24 14:40:33.343444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 389/720] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:40:32 2022] DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments/2460ff86-d072-4236-995e-22cb50cbd516 => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:33.362269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:33.366183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:33.386964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:33.387647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:33.388294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:33.389267 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:33.389745 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:33.390399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:33.432381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b2c1ec59-f107-4622-b70e-d0514df664f4 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082848 Aug 24 14:40:33.432983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 332/721] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:33 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:33.655281 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-51e13171-15fd-4df1-9c37-940b9308d2ca tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: .version_select at 0x7f8a7ff9e790>, body: {"keypair": {"name": "tempest-keypair-1819140350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjkBRdVLTR7C0G9vijS99uXl8/RL/5juAFe1jWufpPe1D/7+37zdKwh4uCupA0Kr2BIeAZ2XY6OjKmgeMOwcaIqyeBn66lS8UH5lxP+Sy5zj/q8FDKIu4WnLA6TXF5PSA=="}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:33.675542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-51e13171-15fd-4df1-9c37-940b9308d2ca tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:33.680795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-51e13171-15fd-4df1-9c37-940b9308d2ca tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'key_pairs'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:33.822838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-51e13171-15fd-4df1-9c37-940b9308d2ca tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172653 Aug 24 14:40:33.823630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 390/722] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:40:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:34.453235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:34.457215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:34.469927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:34.471376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:34.472092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:34.473287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:34.474270 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:34.475041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:34.536884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d9447209-e831-485a-8c49-475f4e7dc542 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090200 Aug 24 14:40:34.538094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 333/723] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:34 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:35.550224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:35.552745 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:35.562864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.562864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.562864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.562864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.563397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.563397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.600152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a7654d9f-ce64-4b4b-b193-881047b90875 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054730 Aug 24 14:40:35.600855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 391/724] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:35 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 14:40:35.694343 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:35.695336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:35.707035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.707550 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.708002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.708741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.709211 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.709646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.741142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:36.075697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-72a24402-d20a-4233-8547-1dc5ee60613f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 204 len: 0 microversion: 2.1 time: 0.386444 Aug 24 14:40:36.076923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 334/725] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:40:35 2022] DELETE /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:36.093477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:36.094882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:36.108267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.109282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.110331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.112465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.114658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.119093 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.344906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:36.354371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-52e7e858-e366-4cd5-8f1e-9a9eaf5d5098 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1689 microversion: 2.1 time: 0.269336 Aug 24 14:40:36.354973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 392/726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:36 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:36.714733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1232349754"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:36.716005 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:36.725926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.726719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.727228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.728077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.728570 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.729010 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.969520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.network.security_group_api [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Removing security group c6860e17-4ee9-44cb-bb7e-b2e235b8f24c from port c3b1b235-fcff-4cfb-8e30-7f144b5c28fc Aug 24 14:40:37.384581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:37.384581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:37.391265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:37.391852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:37.392423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:37.393732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:37.394448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:37.395153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:37.588076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:37.602638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6276f196-de70-485f-acc6-d5fd711e21e2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1689 microversion: 2.1 time: 0.224287 Aug 24 14:40:37.603740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 393/727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:37 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:37.614493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-43566527-e01b-451a-bd52-a47fb0b4abd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action" status: 202 len: 0 microversion: 2.1 time: 0.904267 Aug 24 14:40:37.615287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1668502729", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c1b2e1f-70b2-4451-9050-eb07b892f67d"}], "security_groups": [{"name": "tempest-securitygroup--701253839"}], "key_name": "tempest-keypair-1819140350", "user_data": "}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:37.616139 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 335/728] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:40:36 2022] POST /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:37.656332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:37.698784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:37.709431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:37.710217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:37.760253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] Creating event network-changed:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:40:37.779330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-2b8a7fd2-c671-497d-b660-07f063aef13e req-99b3964a-a998-44b3-8b24-9e9cf79a1dd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143033 Aug 24 14:40:37.780519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 336/729] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:37.848871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] validate_networks() for [('9c1b2e1f-70b2-4451-9050-eb07b892f67d', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:40:38.495584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:40:38.496640 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:40:38.497498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:40:38.498808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:40:38.499364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:40:38.510681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.511260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.511773 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.512605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.513131 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.513631 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.522041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:38.548141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:40:38.548141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Getting quotas for user 34b1955a937f4053967cf82cedd87a2e and project 84e82b68d6da45799b52ce9a6ddaf998. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:40:38.555502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:40:38.558024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:40:38.658833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:38.660089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:38.671382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.672223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.672991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.675473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.676388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.677153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.808277 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2c53c4b5-823b-4d82-9c42-50130c68c36b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.202915 Aug 24 14:40:38.808943 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 394/730] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:40:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:40:38.821073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e0f3a306-4cee-45c5-8ae4-c6efa5221977 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:38.821689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e0f3a306-4cee-45c5-8ae4-c6efa5221977 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:38.884802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e0f3a306-4cee-45c5-8ae4-c6efa5221977 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:38.894210 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e0f3a306-4cee-45c5-8ae4-c6efa5221977 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1242 microversion: 2.1 time: 0.076883 Aug 24 14:40:38.904202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 395/731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:38 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:39.245588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:39.259488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6b916a23-eb30-49d6-b8ed-16707761fe02 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1689 microversion: 2.1 time: 0.608624 Aug 24 14:40:39.261049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 337/732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:38 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1689 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:39.916747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-da566112-8fe7-48a9-bb4b-7db61d1f52aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.917394 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-da566112-8fe7-48a9-bb4b-7db61d1f52aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:39.979937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-da566112-8fe7-48a9-bb4b-7db61d1f52aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:39.988933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-da566112-8fe7-48a9-bb4b-7db61d1f52aa tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1242 microversion: 2.1 time: 0.076396 Aug 24 14:40:39.990403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 396/733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:40.214621 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:40.216235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:40.225553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:40.232321 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.233734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.235108 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.238744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.240113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.241294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.255750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.256691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.258217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.288273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] Creating event network-changed:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:40:40.301204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-46190c07-56be-430b-8538-f1248e565675 req-1b32750b-b8b2-4264-80ab-cf5fa998dba3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086251 Aug 24 14:40:40.303598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 397/734] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:40.315824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:40.317871 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:40.334265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.335731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.337192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.339002 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.340251 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.341857 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.510745 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lazy-loading 'services' on Instance uuid 8080a837-2087-4fc3-a7b6-98b08f83f42d {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:40.598661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:40.608353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-69658eb6-fce2-4207-8ca0-e92c37ae6d67 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1689 microversion: 2.1 time: 0.302514 Aug 24 14:40:40.609923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 398/735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:40 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:40.934215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-82ee653b-465c-45f1-8533-b1f3865348e8 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments/8136c275-6bc9-4de4-ba87-4b71371aa893" status: 202 len: 0 microversion: 2.1 time: 0.729243 Aug 24 14:40:40.934875 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 338/736] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:40:40 2022] DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments/8136c275-6bc9-4de4-ba87-4b71371aa893 => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:40.953379 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:40.957421 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:40.971272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.973697 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.973697 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.973697 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:40.974130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:40.974518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.011425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9b366b7b-25c3-438e-9052-bb646bd68272 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071710 Aug 24 14:40:41.016027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:41.018019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:41.018244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 399/737] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:40 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:41.029555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.030107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.030868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.031609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.032418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.033589 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.143762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:41.171938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a0c6bd67-624b-4df3-8034-d242151c760f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1294 microversion: 2.1 time: 0.162205 Aug 24 14:40:41.173253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 339/738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:41 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:41.632652 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:41.634403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:41.643739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.644802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.645755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.646789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.647426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.648196 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.813934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:41.846873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8aa91856-5943-483d-9b9b-f5549fde6794 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1622 microversion: 2.1 time: 0.218290 Aug 24 14:40:41.851427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 400/739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:41 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1622 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:42.040463 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.041842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:42.046901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:42.069530 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.076279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.077606 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.079219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.084221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.089480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.182758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e6cd07cf-a080-487f-9be3-ec91e4214502 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156950 Aug 24 14:40:42.184412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 340/740] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:42.202680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.203724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:42.210274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:42.217590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.219204 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.220246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.226154 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.227070 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.227896 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.404011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:42.404366 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b", "name": "network-vif-deleted", "tag": "9e7208e6-2078-4850-905f-08f11ec39b61"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:42.423223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-da8b866a-6261-4c3b-851c-6cf1b045ddeb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1302 microversion: 2.1 time: 0.227718 Aug 24 14:40:42.428589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 401/741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1302 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:42.445197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.451485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.464030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.483052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] Creating event network-vif-deleted:9e7208e6-2078-4850-905f-08f11ec39b61 for instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b on hv-cinder-75670 Aug 24 14:40:42.495777 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-64874d6f-11cf-45b9-91cb-63b80aecf1da req-3a430684-594f-4850-b991-355008717079 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097923 Aug 24 14:40:42.496623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 341/742] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:42.893802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.894998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:42.904432 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.905486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.906288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.907395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.908096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.908670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.951936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.952727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.953424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.954288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'fault' on Instance uuid d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:43.024232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:43.037659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8c138660-fe20-450d-b57a-54380bb24997 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 200 len: 1336 microversion: 2.1 time: 0.152195 Aug 24 14:40:43.040187 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 402/743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 1336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:43.208307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.213574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:43.225551 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.229666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.229666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.229666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.230130 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.231019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.307965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5308b904-9254-48c8-b5fb-de877b46c57f tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110336 Aug 24 14:40:43.317603 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 342/744] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:40:43.327855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.328912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:43.341344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.342541 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.343449 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.344979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.346024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.346918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.486934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.488097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:43.511076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] HTTP exception thrown: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d is not attached to volume 8136c275-6bc9-4de4-ba87-4b71371aa893 Aug 24 14:40:43.521824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.527536 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.527842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.529041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.529907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.530778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Request method failure captured: Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments/8136c275-6bc9-4de4-ba87-4b71371aa893 HTTP/1.1 Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjd6GtXxWF4WBX7ftyADfvutckQDyG4XBv56O-vLw6Fz5tii5OFpkDO0yeostuxLqEO-hyOkjpjazXT3IamyjpfEPK_bnoFHb4y68QGQ0KnzL3Py3HyxUFpz_oRCdG1hkNZaHEG2j77Y-4HQoUUX7xFR4QB17Q9GHNmncHwCPSjFv2Y Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 853f7f0f1616478c9744f93293be553e Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:40:43.533370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_853f7f0f1616478c9744f93293be553e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/853f7f0f1616478c9744f93293be553e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853f7f0f1616478c9744f93293be553e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853f7f0f1616478c9744f93293be553e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 853f7f0f1616478c9744f93293be553e Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-TestMinimumBasicScenario-985765589-project Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: de720e2d8a0f4b5f898e00ce90befd58 Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-TestMinimumBasicScenario-985765589-project Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:40:43.536494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d is not attached to volume 8136c275-6bc9-4de4-ba87-4b71371aa893 Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'server_id': '8080a837-2087-4fc3-a7b6-98b08f83f42d', 'id': '8136c275-6bc9-4de4-ba87-4b71371aa893'} Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8136c275-6bc9-4de4-ba87-4b71371aa893. Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:43.538212 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d is not attached to volume 8136c275-6bc9-4de4-ba87-4b71371aa893 Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d is not attached to volume 8136c275-6bc9-4de4-ba87-4b71371aa893 Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:43.547771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Returning 404 to user: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d is not attached to volume 8136c275-6bc9-4de4-ba87-4b71371aa893 {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:43.550134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b6eef3a6-420c-4fdb-b768-e5ec8ceba205 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments/8136c275-6bc9-4de4-ba87-4b71371aa893" status: 404 len: 154 microversion: 2.1 time: 0.220674 Aug 24 14:40:43.550134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 403/745] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:40:43 2022] DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d/os-volume_attachments/8136c275-6bc9-4de4-ba87-4b71371aa893 => generated 154 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:43.585251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:43.653824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:43.662645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d19433fd-1483-42c6-8778-650b455a82d4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1300 microversion: 2.1 time: 0.193726 Aug 24 14:40:43.663468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 343/746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:44.073587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.074134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:44.082110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.082612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.083384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:44.084125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.084804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.085238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:44.102989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] HTTP exception thrown: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Request method failure captured: Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b HTTP/1.1 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcQU4fU91ml_MReRF7S67gknM-h3d06v2-hyoznVH7NxKdVNgWsUroE1sdodqWiiuMg2R1WK87YUsBH30QzQiI93XSWGQ2aIk3c1iKdd09teSLTav9AQTntxqITLXHxhRMLWxpswlZFaAH5bxfdHpfKKqGqFTBK15wdWle_iFWmOZY Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:40:44.104573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7af0efe201074713a9076e220de8ea61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7af0efe201074713a9076e220de8ea61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 3570472f8c2b42b480ec1d1220414bec Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. Aug 24 14:40:44.107575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'd4e1420d-7ce5-4ab5-9d18-0fe7dd50125b'} Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:44.108749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. Aug 24 14:40:44.111982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:44.114216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Returning 404 to user: Instance d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:44.114216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3293f2d4-1408-42de-a60f-3d2114169f9d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b" status: 404 len: 111 microversion: 2.1 time: 0.037870 Aug 24 14:40:44.114216 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 404/747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/servers/d4e1420d-7ce5-4ab5-9d18-0fe7dd50125b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:40:44.121873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4f60fd13-a418-42d8-b253-fcd43a38f6b2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '.version_select at 0x7f8a8c1a4820>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.297686 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4f60fd13-a418-42d8-b253-fcd43a38f6b2 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376835741" status: 202 len: 0 microversion: 2.1 time: 0.181447 Aug 24 14:40:44.298740 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 344/748] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 14:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376835741 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:40:44.705049 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.706354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:44.720574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.721749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.722388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:44.726504 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.727411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.728629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:44.983356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:44.987193 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.988049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:44.996024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-46c2ec2a-bf02-45ae-946c-168e3b8e509e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.300415 Aug 24 14:40:44.997337 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 405/749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:45.000389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:45.001323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:45.002588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:45.003610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:45.004512 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:45.005373 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:45.062733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:45.575091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ecaa5faa-5e75-47fe-a0eb-9686cde20555 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 204 len: 0 microversion: 2.1 time: 0.595096 Aug 24 14:40:45.575677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 345/750] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:40:44 2022] DELETE /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:45.587511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:45.588590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:45.597176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:45.597918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:45.598578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:45.599476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:45.600236 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:45.600774 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:45.836661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:45.846108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d1b253e5-7c61-428d-8bbf-6206bbaeeecb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1554 microversion: 2.1 time: 0.263822 Aug 24 14:40:45.846761 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 406/751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:45 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:46.023801 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:46.024444 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:46.031251 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.031776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.032243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.033786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.034313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.034839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.131550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d03eb9-703e-4e5d-8c06-22f314566c7e", "tag": "7247d453-c2a5-4296-9170-64413b60c529"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:46.150098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.151717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.165104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.180941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] Creating event network-changed:7247d453-c2a5-4296-9170-64413b60c529 for instance 16d03eb9-703e-4e5d-8c06-22f314566c7e on hv-cinder-75670 Aug 24 14:40:46.189755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-d9567231-2129-49bc-8ec8-84dabef6f234 req-33b921aa-c238-446e-9661-00f9934893a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066395 Aug 24 14:40:46.191015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 407/752] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:46.247762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:46.260819 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-531aa6d4-07ae-4d72-bb56-7e6cede8ef46 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.243352 Aug 24 14:40:46.261426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 346/753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:46 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:46.870103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:46.870801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:46.877426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.878149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.878588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.879293 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.879742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.880159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.040749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:47.048936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9d48cc64-7137-4a0a-ae7f-f0704df0f20e tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1554 microversion: 2.1 time: 0.183540 Aug 24 14:40:47.049534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 408/754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:46 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:47.284301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:47.286196 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:47.295652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.296296 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.296746 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.297491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.297976 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.298797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.507733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:47.530392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c77d7d2a-e411-42b1-91f7-44b433a2902b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.250758 Aug 24 14:40:47.550376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 347/755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:47 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:48.071060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:48.071841 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:48.078798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.079338 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.080386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.081479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.081949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.082398 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.266592 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:48.288068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5d43b5e4-9507-41d5-97ca-1bfd1e82e05d tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1554 microversion: 2.1 time: 0.210589 Aug 24 14:40:48.288068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 409/756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:48 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:48.566480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:48.567437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:48.577041 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.577804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.578456 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.579774 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.582910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.583714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.736794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:48.737304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:48.739117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:48.744849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.745359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.745838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.746607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.747081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.747507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.777952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:48.930484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:48.939681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6d723f87-aa49-47d7-9a11-0a8a1aef4115 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.379044 Aug 24 14:40:48.941003 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 348/757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:48 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:48.946084 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8080a837-2087-4fc3-a7b6-98b08f83f42d", "name": "network-vif-deleted", "tag": "c3b1b235-fcff-4cfb-8e30-7f144b5c28fc"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:48.957161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.957647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.958115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.971705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] Creating event network-vif-deleted:c3b1b235-fcff-4cfb-8e30-7f144b5c28fc for instance 8080a837-2087-4fc3-a7b6-98b08f83f42d on hv-cinder-75670 Aug 24 14:40:48.977144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-2c4de78c-dd29-40af-8fa1-c47610fc7c25 req-d3dc9357-3a8e-40c5-8d20-3c5ee4db05ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034697 Aug 24 14:40:48.977845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 349/758] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:49.192798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9b7abded-f4cc-4eb6-b506-328599526519 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 204 len: 0 microversion: 2.1 time: 0.460704 Aug 24 14:40:49.193483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 410/759] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:40:48 2022] DELETE /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:49.202884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.203694 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:49.210817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.211313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.211753 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.212484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.212941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.213369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.311009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.311009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:49.322780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.323687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.324484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.325762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.326632 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.327372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.399122 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:49.408688 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b38978fb-bc0f-48a2-a7d8-1b1a8f5a072a tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1505 microversion: 2.1 time: 0.209360 Aug 24 14:40:49.409298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 350/760] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:49 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:49.427014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:49.435737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-224e385e-e387-47fe-8975-fa9e94367387 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1342 microversion: 2.1 time: 0.135145 Aug 24 14:40:49.436252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 411/761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:49 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:49.963443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:49.964146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:49.971492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.971988 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.972682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.973142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:49.973597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:49.974050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.129372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:50.144144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c5e426d4-f8f8-41c4-a56a-287f1d7ae2c9 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.182965 Aug 24 14:40:50.145196 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 351/762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:49 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:50.442819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:50.443618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:50.445734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=14 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:50.451488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.451980 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.452424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.453143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.453602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.454057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.458324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:50.459535 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:50.466922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.467544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.468075 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.468897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.469675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.471111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.512758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.513631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.514441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.515243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lazy-loading 'fault' on Instance uuid 8080a837-2087-4fc3-a7b6-98b08f83f42d {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:50.577797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:50.589565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-82467cff-f519-406b-81bc-0f35b2d6b2cb tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1347 microversion: 2.1 time: 0.135026 Aug 24 14:40:50.602334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 352/763] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:50 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1347 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:50.609853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:50.618413 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b0b0b086-0b68-4ddb-9a3f-945cac58117c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1505 microversion: 2.1 time: 0.180376 Aug 24 14:40:50.618922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 412/764] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:50 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:51.169483 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.170222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:51.180185 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.180681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.181113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.181870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.182971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.182971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.357666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:51.369210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4423bf67-91e2-44ea-ab48-858633b1373f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.203970 Aug 24 14:40:51.371167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 353/765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:51 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:51.632259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.633621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:51.648859 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.649699 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.649897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.650511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.651399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.651917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:51.652335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.652852 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.677101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.678402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.679359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.680994 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.682370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.683328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.703124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:51.734404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.735667 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.737757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.744389 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lazy-loading 'fault' on Instance uuid 8080a837-2087-4fc3-a7b6-98b08f83f42d {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:51.837159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de720e2d8a0f4b5f898e00ce90befd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853f7f0f1616478c9744f93293be553e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:51.851386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d1423b6d-8536-4062-ad00-ba545123bbd2 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 200 len: 1347 microversion: 2.1 time: 0.226927 Aug 24 14:40:51.854903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 413/766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:51 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 1347 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:52.073556 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:52.089870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-247e32c1-df1d-4682-8caf-a7a50a908685 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1505 microversion: 2.1 time: 0.451794 Aug 24 14:40:52.090957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 354/767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:51 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:52.397584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:52.398497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:52.406337 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.407083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.407309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.408074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.408549 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.408979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.479475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0866ee6c-9955-4a6d-851c-26234e491f75", "name": "network-vif-deleted", "tag": "75d3fb08-defa-4994-842d-bfa415306f5a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:52.495971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.496802 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.497457 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.514067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] Creating event network-vif-deleted:75d3fb08-defa-4994-842d-bfa415306f5a for instance 0866ee6c-9955-4a6d-851c-26234e491f75 on hv-cinder-75670 Aug 24 14:40:52.525530 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-df82149a-49bf-4ce9-b6b6-5c59cde9a4a6 req-39fa5ea6-ba7c-400c-97b4-3d9b09ba7b12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052755 Aug 24 14:40:52.527431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 355/768] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:52.606778 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:52.615840 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9e0807c8-657a-4acc-ac53-47a44cfc9848 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.224954 Aug 24 14:40:52.616551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 414/769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:52 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:52.882845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:52.883463 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] [instance: 8080a837-2087-4fc3-a7b6-98b08f83f42d] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:52.892378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.895941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.895941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.895941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.895941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.896327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.914662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] HTTP exception thrown: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Request method failure captured: Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d HTTP/1.1 Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjd6GtXxWF4WBX7ftyADfvutckQDyG4XBv56O-vLw6Fz5tii5OFpkDO0yeostuxLqEO-hyOkjpjazXT3IamyjpfEPK_bnoFHb4y68QGQ0KnzL3Py3HyxUFpz_oRCdG1hkNZaHEG2j77Y-4HQoUUX7xFR4QB17Q9GHNmncHwCPSjFv2Y Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 853f7f0f1616478c9744f93293be553e Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:40:52.922031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_853f7f0f1616478c9744f93293be553e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/853f7f0f1616478c9744f93293be553e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853f7f0f1616478c9744f93293be553e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853f7f0f1616478c9744f93293be553e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 853f7f0f1616478c9744f93293be553e Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-TestMinimumBasicScenario-985765589 Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-TestMinimumBasicScenario-985765589-project Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: de720e2d8a0f4b5f898e00ce90befd58 Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-TestMinimumBasicScenario-985765589-project Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. Aug 24 14:40:52.923990 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '8080a837-2087-4fc3-a7b6-98b08f83f42d'} Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:52.924731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. Aug 24 14:40:52.926220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:40:52.930095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Returning 404 to user: Instance 8080a837-2087-4fc3-a7b6-98b08f83f42d could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:52.931538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-37ce0dd5-3ff6-4bdf-ace5-ea769122ac79 tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d" status: 404 len: 111 microversion: 2.1 time: 0.055226 Aug 24 14:40:52.932339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 356/770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:52 2022] GET /compute/v2.1/servers/8080a837-2087-4fc3-a7b6-98b08f83f42d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:40:52.943623 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-659c4dcd-bb43-4ce9-a855-eb81cbb7223c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] Calling method '.version_select at 0x7f8a7ff38af0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:53.051257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-659c4dcd-bb43-4ce9-a855-eb81cbb7223c tempest-TestMinimumBasicScenario-985765589 tempest-TestMinimumBasicScenario-985765589-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-54865592" status: 202 len: 0 microversion: 2.1 time: 0.112793 Aug 24 14:40:53.051955 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 415/771] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 14:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-54865592 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:53.127610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:53.128913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:53.138345 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.138924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.139466 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.140404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.141081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.141594 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.187570 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.188363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.189157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.190192 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'fault' on Instance uuid 0866ee6c-9955-4a6d-851c-26234e491f75 {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:53.518699 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:53.526633 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-780a23c1-7a47-44ed-96f2-1ed352c8fbeb tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 200 len: 1310 microversion: 2.1 time: 0.407877 Aug 24 14:40:53.527227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 357/772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:53 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:53.645162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:53.646327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:53.654120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.654714 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.655174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.655945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.656414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.657052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.854494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:53.869706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-505780ff-b632-4316-b1fc-2321bb1fc53b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.233614 Aug 24 14:40:53.872078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 416/773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:53 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:53.947255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d03eb9-703e-4e5d-8c06-22f314566c7e", "name": "network-vif-plugged", "status": "completed", "tag": "7247d453-c2a5-4296-9170-64413b60c529"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:53.958318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.958810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.961409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.971833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] Creating event network-vif-plugged:7247d453-c2a5-4296-9170-64413b60c529 for instance 16d03eb9-703e-4e5d-8c06-22f314566c7e on hv-cinder-75670 Aug 24 14:40:53.977214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-baafdc39-d671-4e38-b8a1-4b38148eb9db req-12182204-645f-42c3-a617-26fb7d031cde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099114 Aug 24 14:40:53.977775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 358/774] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:54.548286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:54.549655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 0866ee6c-9955-4a6d-851c-26234e491f75] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:54.555937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.556301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.556742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.557450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.557905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.558361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.739133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] HTTP exception thrown: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Request method failure captured: Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 HTTP/1.1 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcQU4fU91ml_MReRF7S67gknM-h3d06v2-hyoznVH7NxKdVNgWsUroE1sdodqWiiuMg2R1WK87YUsBH30QzQiI93XSWGQ2aIk3c1iKdd09teSLTav9AQTntxqITLXHxhRMLWxpswlZFaAH5bxfdHpfKKqGqFTBK15wdWle_iFWmOZY Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:40:54.740816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7af0efe201074713a9076e220de8ea61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7af0efe201074713a9076e220de8ea61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 3570472f8c2b42b480ec1d1220414bec Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. Aug 24 14:40:54.743483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '0866ee6c-9955-4a6d-851c-26234e491f75'} Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:54.745106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. Aug 24 14:40:54.747954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:40:54.749542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Returning 404 to user: Instance 0866ee6c-9955-4a6d-851c-26234e491f75 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:54.749542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9b858f78-da54-4942-a327-a8f160bd9ede tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75" status: 404 len: 111 microversion: 2.1 time: 0.198143 Aug 24 14:40:54.749542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 417/775] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:54 2022] GET /compute/v2.1/servers/0866ee6c-9955-4a6d-851c-26234e491f75 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:40:54.755006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:54.755644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:54.763801 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.764356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.764799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.765514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.765965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.766443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.797406 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:40:54.905011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:54.905655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:54.913516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.914028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.914467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.920038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:54.920570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:54.920983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:54.931039 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:55.069939 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:55.078503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f9b76de2-36ee-4707-a44e-955cb4666527 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.177336 Aug 24 14:40:55.087830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 418/776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:54 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:55.203454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1c571d2b-d9f9-434b-96f6-dacd47d49025 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "DELETE /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 204 len: 0 microversion: 2.1 time: 0.453703 Aug 24 14:40:55.204292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 359/777] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:40:54 2022] DELETE /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:55.218346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:55.219539 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:55.232371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:55.233233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:55.234051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:55.235383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:55.236872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:55.237898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:55.432635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:55.445662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c3884869-0b3d-4ffd-8683-096292a5897f tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.234201 Aug 24 14:40:55.446903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 419/778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:55 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:55.823548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:55.824232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:55.836065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:55.836784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:55.837477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:55.838630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:55.839223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:55.839895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:55.868850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-26482e91-6f0f-4f0f-a0f8-3bcdb1f1dd61 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/ips" status: 200 len: 153 microversion: 2.20 time: 0.049656 Aug 24 14:40:55.869528 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 360/779] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 24 14:40:55 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:40:56.099993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:56.100690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:56.107716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:56.108215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:56.108675 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:56.109389 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:56.109855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:56.110334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:56.300971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:56.313329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cdf4dd4b-824d-45c1-8797-5dc9b492f83b tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.217587 Aug 24 14:40:56.315811 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 420/780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:56 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:56.471757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:56.472454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:56.479006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:56.479503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:56.479948 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:56.480662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:56.481329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:56.481927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:56.725004 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:56.739625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9b60fb1e-ee18-4382-be42-1723f3795461 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.273259 Aug 24 14:40:56.740808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 361/781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:56 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:57.343376 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:57.344716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:57.355478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.355979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.356991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.357734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.358247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.362223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.573894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:57.587481 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6f6a89dc-e4bb-4acb-a16b-937714b715e1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1367 microversion: 2.1 time: 0.247936 Aug 24 14:40:57.588550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 421/782] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:57 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:57.774144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:57.775350 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:57.782688 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.786855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.786855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:57.786855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:57.786855 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:57.787479 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.145769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:58.161547 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-526d4d18-5d0f-428a-867a-8c120ab17dbe tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1521 microversion: 2.1 time: 0.390979 Aug 24 14:40:58.162659 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 362/783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:57 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:58.610011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:58.612091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:58.619247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.624185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.624914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.625860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.627626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.627626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.880644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:58.891016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a85f6dd1-cb9e-4f85-b22a-ecaac917003a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1557 microversion: 2.1 time: 0.285772 Aug 24 14:40:58.891742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 422/784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:58 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1557 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:58.899183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:58.901815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:58.911237 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.911991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.912755 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.913702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.914528 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.915199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.927351 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:58.929268 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:58.943803 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.944575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.945446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.947097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:58.948260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:58.948994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:58.965078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lazy-loading 'flavor' on Instance uuid f0c93ce4-7c64-40f5-92e6-6af373a1c01f {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:59.116328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-78e2a3cc-f96c-4602-8489-ec8ccd1c5f6f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196703 Aug 24 14:40:59.117215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 423/785] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 14:40:58 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:40:59.194658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:59.195453 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:59.203420 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.204076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.205400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.206616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.207238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.207794 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.322516 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:59.369305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-54fe6311-f5a7-40ab-b5a5-a211766ba5e6 tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1479 microversion: 2.1 time: 0.178889 Aug 24 14:40:59.371379 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 424/786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:59 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1479 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:59.521909 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945183a7-1a55-4233-af05-abb55ac82c9b", "name": "network-vif-deleted", "tag": "5152e60f-ed71-495b-ad60-a57247c3b63b"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:59.550460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.551006 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.551596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.565887 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] Creating event network-vif-deleted:5152e60f-ed71-495b-ad60-a57247c3b63b for instance 945183a7-1a55-4233-af05-abb55ac82c9b on hv-cinder-75670 Aug 24 14:40:59.573464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-e35967fc-6095-4268-aea6-379c12d91251 req-c615f9f3-54c4-4565-a503-6ef4485ad68c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064033 Aug 24 14:40:59.574274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 425/787] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:40:59.728290 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-47f2326d-19cc-40e2-9b5f-6b6614ecfe1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/action" status: 202 len: 0 microversion: 2.20 time: 0.836534 Aug 24 14:40:59.729583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 363/788] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 14:40:58 2022] POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:40:59.742589 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:59.745085 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:59.763939 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.764472 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.764992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:59.768068 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:59.768573 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:59.769022 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.412441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:00.413652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:00.427705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:00.428552 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:00.429284 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.430244 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:00.430943 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:00.431559 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.441288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.457984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.461425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.463700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-086f6497-57d5-4c57-bb31-a9b729453b7f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.727883 Aug 24 14:41:00.464815 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 426/789] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:40:59 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:00.512562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:00.512562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:00.513399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:00.514238 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lazy-loading 'fault' on Instance uuid 945183a7-1a55-4233-af05-abb55ac82c9b {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:00.598724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3570472f8c2b42b480ec1d1220414bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0efe201074713a9076e220de8ea61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:00.616320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8cc2a219-11af-48ea-9bcc-9bafeb960a8d tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 200 len: 1312 microversion: 2.1 time: 0.210971 Aug 24 14:41:00.617527 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 364/790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:00 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:01.330733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d03eb9-703e-4e5d-8c06-22f314566c7e", "tag": "7247d453-c2a5-4296-9170-64413b60c529"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:01.342564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.343434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.345574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.359528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] Creating event network-changed:7247d453-c2a5-4296-9170-64413b60c529 for instance 16d03eb9-703e-4e5d-8c06-22f314566c7e on hv-cinder-75670 Aug 24 14:41:01.365843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-3e030951-df2d-4c32-83a9-7789996a7ad9 req-c450fdf0-6e8a-448c-ad7a-7a37454f4c72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042911 Aug 24 14:41:01.367385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 427/791] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:01.492134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:01.495296 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:01.505183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.508951 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.510436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.511591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.512377 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.513077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.653982 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:01.655270 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] [instance: 945183a7-1a55-4233-af05-abb55ac82c9b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:01.666902 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.668070 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.668763 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.669875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:01.670681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:01.671806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:01.711587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] HTTP exception thrown: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Request method failure captured: Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b HTTP/1.1 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcQU4fU91ml_MReRF7S67gknM-h3d06v2-hyoznVH7NxKdVNgWsUroE1sdodqWiiuMg2R1WK87YUsBH30QzQiI93XSWGQ2aIk3c1iKdd09teSLTav9AQTntxqITLXHxhRMLWxpswlZFaAH5bxfdHpfKKqGqFTBK15wdWle_iFWmOZY Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:41:01.714830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7af0efe201074713a9076e220de8ea61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7af0efe201074713a9076e220de8ea61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7af0efe201074713a9076e220de8ea61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 7af0efe201074713a9076e220de8ea61 Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1387289542 Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 3570472f8c2b42b480ec1d1220414bec Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1387289542-project Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. Aug 24 14:41:01.717501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '945183a7-1a55-4233-af05-abb55ac82c9b'} Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:01.719600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. Aug 24 14:41:01.726575 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:01.733180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] Returning 404 to user: Instance 945183a7-1a55-4233-af05-abb55ac82c9b could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:01.733180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d808dbb2-f557-46f0-bfa2-be0ac3d4184c tempest-ServerRescueNegativeTestJSON-1387289542 tempest-ServerRescueNegativeTestJSON-1387289542-project] 10.222.0.49 "GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b" status: 404 len: 111 microversion: 2.1 time: 0.071997 Aug 24 14:41:01.733180 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 428/792] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:01 2022] GET /compute/v2.1/servers/945183a7-1a55-4233-af05-abb55ac82c9b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:41:01.932038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:01.961454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:01.967391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:01.974495 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6c74c914-7e5f-498a-aab7-43aa97868d58 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.487872 Aug 24 14:41:01.976290 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 365/793] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:01 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:03.017769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:03.019201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:03.036171 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.037620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.038920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:03.041057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:03.042537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:03.043881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:03.350939 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:03.361327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:03.364612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:03.366397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bf58ddf7-fab1-4991-9685-5df8992b5f2e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.353320 Aug 24 14:41:03.367283 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 429/794] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:03 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:04.409058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:04.409846 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:04.419596 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:04.420285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:04.421033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:04.422417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:04.426232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:04.427027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:04.713071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.734797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.739971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:04.742860 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fcc1efb5-7a35-4ddd-a1a1-7bf30b3088c1 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.340506 Aug 24 14:41:04.750045 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 366/795] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:04 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:05.778111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:05.780665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:05.796946 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.798917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.799854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:05.814894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:05.814894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:05.814894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:06.103786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:06.121424 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:06.127218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:06.131001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0fcb83b2-e9c0-493e-9108-8687c5ee5de5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.364923 Aug 24 14:41:06.133126 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 430/796] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:05 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:07.163437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:07.169730 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:07.214640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.215523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.216271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:07.218561 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:07.219492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:07.220320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:07.638024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:07.645333 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:07.647703 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:07.649133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d6f3e8d6-cbf4-4918-a6e0-819122045d13 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.495461 Aug 24 14:41:07.649926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 367/797] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:07 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:08.579969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:08.581905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:08.602636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.606825 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.608209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.610185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.612465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.613845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.671443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a72be7c9-0540-428e-8c78-7d831b4148ad tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/ips" status: 200 len: 146 microversion: 2.1 time: 0.103747 Aug 24 14:41:08.672648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 431/798] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:41:08 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/ips => generated 146 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:08.678581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:08.680780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:08.697325 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.698649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.699531 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.700963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:08.701904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:08.702847 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:08.997033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:09.012470 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:09.015491 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:09.018351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7736cb5b-2a6c-4fe3-9b7c-6be904ca9329 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.348286 Aug 24 14:41:09.019438 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 368/799] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:08 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:10.058227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:10.059299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:10.070295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.070919 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.071506 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.072449 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.073120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.073662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.325242 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.335287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.350686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:10.350686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-47f5c858-8798-40f4-99e0-fa8279f2fcd6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.287886 Aug 24 14:41:10.350686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 432/800] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:10 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:10.647223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0be94f0a-0756-4bd6-a94e-3d614c5ab202"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:10.651354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:10.670693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.670693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.670693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:10.670693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:10.671271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:10.671271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.368417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:11.370786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:11.384240 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.385105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.386044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.387253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:11.388141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:11.388928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:11.591684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:11.602065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:11.603713 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:11.605370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-790e0d55-d29c-41d8-9ff1-283d8ebf6a9b tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.247038 Aug 24 14:41:11.606168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 433/801] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:11 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:11.813205 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-63ac9c42-580c-484c-8c19-0262eb401734 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.178624 Aug 24 14:41:11.815452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 369/802] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:41:10 2022] POST /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 194 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:12.633972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:12.634986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:12.643703 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:12.644330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:12.644878 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:12.645696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:12.646234 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:12.646727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:12.651642 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:12.823700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.835930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.838767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:12.841034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0fa4f2d1-80e8-4a4d-b4ae-10977cd9384c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.211460 Aug 24 14:41:12.842091 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 434/803] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:12 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:13.872494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.875169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:13.878055 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:13.887523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.893060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.893060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.893060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.893060 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.893689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.900465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-344c83e8-ce9c-404b-84d1-c0c47e4136d8 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff47790>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.958365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-344c83e8-ce9c-404b-84d1-c0c47e4136d8 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9274a6dd-3c92-4961-af2d-dc031a3892ee" status: 200 len: 351 microversion: 2.1 time: 0.061508 Aug 24 14:41:13.959127 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 435/804] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/os-volumes/9274a6dd-3c92-4961-af2d-dc031a3892ee => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:14.107482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.118590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.120550 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.122100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d2534bc7-8afa-4e7c-9a31-91b207fd683f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.257951 Aug 24 14:41:14.122909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 370/805] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:15.161174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:15.161174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:15.161174 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:15.164133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.164724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.165311 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:15.166423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.167050 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.167721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:15.341175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.357378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.361469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.363765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-80bfe757-1f37-4195-93b6-339239766e5a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.218431 Aug 24 14:41:15.364798 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 436/806] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:15 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:15.987020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e71cd30f-66a5-4599-9747-6473525ebfb5 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ffb8160>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.050521 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e71cd30f-66a5-4599-9747-6473525ebfb5 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e5f87353-2028-4dbc-9e2a-986566d88f68" status: 200 len: 350 microversion: 2.1 time: 0.068488 Aug 24 14:41:16.051197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 371/807] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:41:15 2022] GET /compute/v2.1/os-volumes/e5f87353-2028-4dbc-9e2a-986566d88f68 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:16.395725 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.396449 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:16.405891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.406502 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.407060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.408296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.408813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.409291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.580538 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.589679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.591344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.592618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5dc166fc-994e-45f1-bf7c-a844d0f16a29 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.202495 Aug 24 14:41:16.593211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 437/808] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:16 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:17.617918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.618786 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:17.630461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.630970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.631413 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.632401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.632857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.633284 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.792902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.803116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.805086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.806390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-86b7e8b3-9458-4439-b4a0-45d14b68981c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.192469 Aug 24 14:41:17.807000 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 372/809] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:17.886938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0081aaed-78d8-453c-b0fa-e1aaa3de9289 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff8f280>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.942010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0081aaed-78d8-453c-b0fa-e1aaa3de9289 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f1e5ab42-75d7-4e0a-9ea3-8fb9d637a84a" status: 200 len: 351 microversion: 2.1 time: 0.059046 Aug 24 14:41:17.942863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 438/810] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/os-volumes/f1e5ab42-75d7-4e0a-9ea3-8fb9d637a84a => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:17.957029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ffb94080-e809-4240-8789-a85b562518ba tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff9bd30>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.050225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ffb94080-e809-4240-8789-a85b562518ba tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.097480 Aug 24 14:41:18.051186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 373/811] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:18.066752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b1f87fd8-3ae7-4a74-9e99-0fec0cb6e11a tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a90941040>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.158368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b1f87fd8-3ae7-4a74-9e99-0fec0cb6e11a tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096089 Aug 24 14:41:18.159419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 439/812] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:18.181081 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-39d2afd5-def8-4212-9619-667f13c9a4ae tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff04f70>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.298732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-39d2afd5-def8-4212-9619-667f13c9a4ae tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.120256 Aug 24 14:41:18.300057 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 374/813] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:18.317719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5e0cbe15-73be-412e-aae2-b392ebd46a98 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff82ca0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.420528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5e0cbe15-73be-412e-aae2-b392ebd46a98 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.110281 Aug 24 14:41:18.424368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 440/814] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:18.437640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2bbec67f-2730-4707-aa4d-d96d6dbd9e93 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a8df87430>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.527225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2bbec67f-2730-4707-aa4d-d96d6dbd9e93 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093834 Aug 24 14:41:18.527893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 375/815] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:18.543695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c894bf54-0aa4-4143-bddc-6415a99de3ff tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff8f790>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.642534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c894bf54-0aa4-4143-bddc-6415a99de3ff tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099063 Aug 24 14:41:18.642534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 441/816] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:18.654403 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66f59156-f2ef-4f0b-974a-5208e962a0ea tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff04790>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.745025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66f59156-f2ef-4f0b-974a-5208e962a0ea tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094567 Aug 24 14:41:18.746107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 376/817] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:18.760350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ff7cae45-0250-4afe-add6-bac340b4b003 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] Calling method '.version_select at 0x7f8a7ff38670>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.831574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.832231 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.839386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.839874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.840308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.841231 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.841708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.842177 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.907585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ff7cae45-0250-4afe-add6-bac340b4b003 tempest-VolumesTestJSON-959665524 tempest-VolumesTestJSON-959665524-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.151170 Aug 24 14:41:18.908554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 442/818] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:19.037735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:19.048216 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:19.050634 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:19.052411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1dfae350-4d93-4964-93f6-eeaf217c443c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.225336 Aug 24 14:41:19.053124 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 377/819] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:19.567646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.570088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.577064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.577568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.578038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.578779 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.579475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.580079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.614930 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-29fc249b-09ba-4583-8f4b-a81c6fa9dd81 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Aug 24 14:41:19.615535 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 443/820] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:19.632904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.633795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.652044 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.652935 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.653741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.655174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.656012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.656924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.663299 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:19.720883 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c4c8323e-5187-4aa3-b857-605c36586a26 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202" status: 200 len: 194 microversion: 2.1 time: 0.096221 Aug 24 14:41:19.722061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 378/821] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:20.080208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:20.081230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:20.092747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.093401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.093961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.095786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.096684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.100409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.265670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.275051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.280322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.280322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bc19fbf8-0e69-4b04-97aa-9be17d404def tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.204800 Aug 24 14:41:20.280322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 444/822] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:20 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:21.306080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.306818 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.315381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.315874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.316308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.317026 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.317477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.317897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.489905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.503181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.504803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.506077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-44311c2a-077b-4a5b-a8c1-ddeb2d49cf3a tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1745 microversion: 2.20 time: 0.206191 Aug 24 14:41:21.506950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 379/823] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:21.852130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8d6db3c-49ca-4b63-b19d-1ae71ee00ed7"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:21.854734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.862761 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.863264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.867536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.867536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.867536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.867536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.531056 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:22.531817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:22.539717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.540214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.540657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.541388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.541854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.542315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.742287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.754369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.754876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.756105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c2c3ebef-e35f-405f-8612-cd07f48c1165 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1745 microversion: 2.20 time: 0.229493 Aug 24 14:41:22.756952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 380/824] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:22 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:23.059257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6ec1e285-27aa-4da3-bb7a-e069e7e8c918 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "POST /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.210782 Aug 24 14:41:23.060123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 445/825] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:41:21 2022] POST /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 194 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:23.779266 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "name": "network-vif-plugged", "status": "completed", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:23.791733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.792219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.792653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.798295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:23.799175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:23.806399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.806845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] Creating event network-vif-plugged:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:41:23.806967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.807326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.808063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.808561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.809009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.813804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-e6af291d-b83a-490d-a562-9fa57ec72957 req-6b19cc43-c836-4e80-85a6-aa11d78e5b71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038727 Aug 24 14:41:23.815426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 381/826] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:24.073520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.093666 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.098170 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.108767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7024bf07-ccc8-45e1-bf9d-6cbca615a991 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.315468 Aug 24 14:41:24.119973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 446/827] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:23 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:25.142682 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:25.145245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:25.160059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.161308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.162401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.164341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.165418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.166398 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.442281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.454764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.456910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.458799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2d26851f-f472-4dda-998c-542f5b78b30d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.326520 Aug 24 14:41:25.459475 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 382/828] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:25 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:26.499269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.501471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.545064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.545957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.550284 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.551834 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.553153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.554366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.805028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.819279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.821580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.823054 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4d6e1313-b7c7-431b-8d49-bdd5c7d5ae5d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.332020 Aug 24 14:41:26.824165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 447/829] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:27.864449 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:27.865698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:27.872235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.872735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.873178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.873900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.874548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.875168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.067876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.079512 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.082135 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.083385 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-96a8bf0b-893e-4ff7-ac80-582f15e0b853 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.224476 Aug 24 14:41:28.095993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 383/830] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:27 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:29.108451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.109143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:29.121442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.122636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.123812 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.124843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.125440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.127551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.406243 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.427682 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.430551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.432605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2dba33a0-35cb-4e7c-a90e-11b3b9ca3ff8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.327874 Aug 24 14:41:29.434272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 448/831] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:30.480166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:30.481702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.502471 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.503640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.504436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.505793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.506980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.507732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.733849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.749621 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.758835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.762650 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fb4f8d78-435f-4c08-968f-d9b17266cc89 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.293802 Aug 24 14:41:30.765119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 384/832] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:30 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:31.792479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.793855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.809024 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.809853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.810645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.811884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.814167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.815079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.067149 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.088437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.092731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.095503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e7762f3d-19dc-48ef-b581-186538a14b2f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.306696 Aug 24 14:41:32.096969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 449/833] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:32.259269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.261332 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.293407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.294453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.295613 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.297237 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.301506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.303198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.388368 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-213eb624-5ce0-4619-b5d2-724aa62a4f58 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.133408 Aug 24 14:41:32.398869 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 385/834] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:32.541406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.542446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.553025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.554339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.555322 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.556782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.557746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.559013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.651027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a055270d-b327-4ab0-acb1-09569c9b3c65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202" status: 200 len: 194 microversion: 2.1 time: 0.115325 Aug 24 14:41:32.656636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 450/835] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202 => generated 194 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:32.667460 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.668276 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.676067 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.676849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.677489 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.678456 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.679107 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.679711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.836942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lazy-loading 'services' on Instance uuid 1dca5a2a-236a-433b-af27-004eab6505de {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:33.117142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8fc884ee-f7d5-466a-b42d-d00aab8972d2 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202" status: 202 len: 0 microversion: 2.1 time: 0.453535 Aug 24 14:41:33.118801 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 386/836] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:41:32 2022] DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/0be94f0a-0756-4bd6-a94e-3d614c5ab202 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:41:33.134829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:33.135612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:33.148692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.149166 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.149626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.152680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.158315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.159169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.367894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.380796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.383329 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.384796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2f6ad97c-1c1d-4e95-987c-1e649022d947 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.256286 Aug 24 14:41:33.385764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 451/837] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:33 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:34.429611 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:34.431324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:34.440892 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.441885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.444439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.448933 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.451207 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.451468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.669197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.680635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.682387 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.683681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9d07378d-d705-4937-a031-10d43bfb1823 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.267203 Aug 24 14:41:34.690093 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 387/838] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:34 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:35.408692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.410026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.416748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.417237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.417671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.418419 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.418877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.419306 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.459463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-080b1579-a01e-4e97-bc3b-811122be2125 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/e8d6db3c-49ca-4b63-b19d-1ae71ee00ed7" status: 200 len: 194 microversion: 2.1 time: 0.054821 Aug 24 14:41:35.460543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 452/839] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 14:41:35 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/e8d6db3c-49ca-4b63-b19d-1ae71ee00ed7 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:35.474952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.474952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.484187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.484719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.485277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.486021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.486468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.486890 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.590448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lazy-loading 'services' on Instance uuid 1dca5a2a-236a-433b-af27-004eab6505de {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:35.725286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.726184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.733640 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.734486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.735708 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.737009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.737820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.738555 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.964440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fa71aec6-8b05-44c5-9958-77974c6d5da0 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/e8d6db3c-49ca-4b63-b19d-1ae71ee00ed7" status: 202 len: 0 microversion: 2.1 time: 0.495192 Aug 24 14:41:35.965646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 388/840] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:41:35 2022] DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments/e8d6db3c-49ca-4b63-b19d-1ae71ee00ed7 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:41:36.007480 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.025129 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.029866 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.038458 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d8520dba-d237-46f2-85a3-23cc0a0cc102 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.318328 Aug 24 14:41:36.059062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 453/841] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:35 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:36.769794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.770501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.777416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.777907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.778386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.779105 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.779564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.779993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.807711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7ecd0619-9e04-4b64-8e62-1a5161b6419e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/ips" status: 200 len: 149 microversion: 2.1 time: 0.043147 Aug 24 14:41:36.808310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 389/842] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:37.080018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.081164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.087670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.088223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.088602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.089302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.089760 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.090211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.287669 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:37.296885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:37.299408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:37.300704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-32fe5c7a-825f-42d3-b177-babf3f3af88f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.227259 Aug 24 14:41:37.301455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 454/843] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:38.325082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:38.325901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:38.334427 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:38.334932 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:38.335386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.336092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:38.336559 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:38.336986 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.493608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.509106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.512235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.514579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d419ec36-06fa-4e6b-8013-e45348e4dac5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1740 microversion: 2.20 time: 0.193238 Aug 24 14:41:38.515212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 390/844] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:38 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:39.556014 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.557012 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.569591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.570586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.571314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.572493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.573370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.574143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.614299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:39.707499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1184b2-d4fb-4c90-abf4-3854340b6fce"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:39.712014 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.724782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.725678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.727110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.728425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.729258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.730033 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.809856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.823309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.827081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.829542 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-355b3ba4-d084-46db-8f2c-71ee92521771 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1722 microversion: 2.20 time: 0.280070 Aug 24 14:41:39.831848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 455/845] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:40.823422 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.825770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.835034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.835533 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.835972 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.836688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.837145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.837570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.879749 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-61566122-d83f-4292-b993-f3f91f94d114 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060625 Aug 24 14:41:40.880725 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 456/846] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 14:41:40.887226 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.887838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.895885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.896539 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.897125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.897606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.898340 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.905898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.021738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c7241cbe-5968-44c4-8eb5-64e79a6695a6 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "POST /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.319056 Aug 24 14:41:41.024442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 391/847] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:41:39 2022] POST /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments => generated 194 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:41.066615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.069383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.076185 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.076782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.077305 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.078169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.079795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.080442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.103160 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.117270 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.119953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-92852933-e06d-4f9c-bd95-72688041a429 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058586 Aug 24 14:41:41.120861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 392/848] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 14:41:41.126455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.128074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a2dd0e1c-dbaf-4253-b2c1-228b94e7969f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1722 microversion: 2.20 time: 0.244874 Aug 24 14:41:41.128805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 457/849] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:41.202529 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.205984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.210834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.211328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.211773 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.212498 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.212962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.213389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.216530 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:41.244545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:41:41.580020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-aedda226-f5e8-4b36-a7fc-18517061d21b tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 204 len: 0 microversion: 2.1 time: 0.381131 Aug 24 14:41:41.580725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 393/850] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:41:41 2022] DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:41:41.590016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.592941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.597878 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.598418 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.598851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.599646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.600060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.600483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.754323 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.763319 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7e0157ae-a1f7-434d-b366-6fa2b18422c6 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1673 microversion: 2.1 time: 0.177313 Aug 24 14:41:41.764044 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 458/851] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.877507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:41.888106 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.888851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.889208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.902926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] Creating event network-vif-unplugged:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:41:41.909260 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-7214c3d0-ff16-4426-ae7b-adcac5da09ab req-cdd1063d-daa3-42b0-9b34-18b1c8eca380 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036751 Aug 24 14:41:41.910111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 394/852] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:42.167984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.169021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.195938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.195938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.195938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.195938 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.196802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.196802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.379684 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.391367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.392897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.394124 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c3399fd9-80f3-44cc-81c5-5183dbe0737f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1722 microversion: 2.20 time: 0.234347 Aug 24 14:41:42.394702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 459/853] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:42.788354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.789116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.796153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.796655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.797150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.797881 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.798390 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.798822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.952670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.961885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-28e7fbbd-79f6-4b74-b0bd-9c566b80c5b1 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1673 microversion: 2.1 time: 0.178568 Aug 24 14:41:42.962525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 395/854] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:43.437042 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.438762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.451150 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.452072 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.452868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.454803 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.455729 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.456649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.698710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.709008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.710737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.712063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a8cd59ae-55f2-4e88-910a-99d163e237c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1722 microversion: 2.20 time: 0.282466 Aug 24 14:41:43.713057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 460/855] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:43.989781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.998965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.014028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.014898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.015692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.017539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.018416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.019235 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.414870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.424289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-71d6db51-1996-4c79-9590-a71aa5ee9f42 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1673 microversion: 2.1 time: 0.442725 Aug 24 14:41:44.424884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 396/856] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1673 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:44.760011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:44.761647 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.773753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.774616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.775408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.777173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.788698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.788698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.956102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.965757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.967509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.968742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b8d01cc8-757f-4f59-8f29-60eb16061ead tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1665 microversion: 2.20 time: 0.221361 Aug 24 14:41:44.974218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 461/857] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:44 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1665 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:41:44.997865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b13d1fa9-1d09-4673-a9bd-3161637d66fb"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:45.002050 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.004473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:45.009899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.010709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.011150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.011865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.012333 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.012750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.227253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca5a2a-236a-433b-af27-004eab6505de", "name": "network-vif-deleted", "tag": "587f3fb6-6858-4261-b25e-e2689a06d71e"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:45.238633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.239121 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.239558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.252916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] Creating event network-vif-deleted:587f3fb6-6858-4261-b25e-e2689a06d71e for instance 1dca5a2a-236a-433b-af27-004eab6505de on hv-cinder-75670 Aug 24 14:41:45.259106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-837127b6-8199-49d8-a0ca-b9d325a758db req-5a10becd-eb91-47b4-b64c-1edbabfe089a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035539 Aug 24 14:41:45.264617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 462/858] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:45.457805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.461669 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.484843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.485888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.486471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.487292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.487838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.488349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.567890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b946ecd87434ad6a00890887d234281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc03440f454c15abb4aab9bf6e2374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:45.584676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bfb26043-dc9c-45a6-9a0c-4f79bc4da563 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 200 len: 1321 microversion: 2.1 time: 0.140894 Aug 24 14:41:45.585303 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 463/859] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:46.616463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:46.617293 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:46.621110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=46 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:46.626225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.626781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.627230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.627953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.628417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.628847 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.655344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de HTTP/1.1 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:41:46.657111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:46.658873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '1dca5a2a-236a-433b-af27-004eab6505de'} Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:46.659819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:46.661167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:46.663606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:46.664497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-eb858860-f769-4c6b-bf4b-740a9cee0a9d tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 404 len: 111 microversion: 2.1 time: 0.061953 Aug 24 14:41:46.665089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 464/860] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:46 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:41:46.675133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-838787a2-bccf-4ef2-a5ca-9f8fa79dd739 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '.version_select at 0x7f8a7ff293a0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:46.800370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-838787a2-bccf-4ef2-a5ca-9f8fa79dd739 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824111189" status: 202 len: 0 microversion: 2.1 time: 0.129670 Aug 24 14:41:46.800961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 465/861] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 14:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824111189 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:41:46.853231 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a4cce6fd-63e0-4c58-a7ea-1306cada1f68 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.861798 Aug 24 14:41:46.860804 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 397/862] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 24 14:41:44 2022] POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments => generated 188 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:41:47.056314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:47.056844 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:47.063818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.068179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.068179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.068179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.068179 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.068781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.041580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-200d34dc-667f-41d2-a4ea-4b11a468080e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments/b13d1fa9-1d09-4673-a9bd-3161637d66fb" status: 202 len: 0 microversion: 2.20 time: 0.989154 Aug 24 14:41:48.042848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 466/863] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 24 14:41:47 2022] DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments/b13d1fa9-1d09-4673-a9bd-3161637d66fb => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:41:48.116366 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:48.117181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.124309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.131674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.131674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.131674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.131674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.132410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.372989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127923) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:41:48.801315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2362d974-a420-4eac-ac5f-97c9b3345a50 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/action" status: 202 len: 0 microversion: 2.20 time: 0.689278 Aug 24 14:41:48.804973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 398/864] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 14:41:48 2022] POST /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:41:48.811164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:48.811378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.819672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.820176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.820620 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.821341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.821813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.822269 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.011408 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.023699 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.026987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.026987 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d35545e3-a0bd-4b3a-ad90-3b3e42d8df12 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1673 microversion: 2.20 time: 0.219856 Aug 24 14:41:49.043158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 467/865] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:48 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:50.055524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.056335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.065218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.067100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.067100 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.067674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.067911 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.068602 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.291807 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.310668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.312218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.314515 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-08bfc4c1-dab7-4a03-802b-f08756a97b86 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1673 microversion: 2.20 time: 0.265374 Aug 24 14:41:50.315503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 399/866] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:50.714789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.715731 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.728614 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.729607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.730434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.731817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.732610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.733341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.760468 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de HTTP/1.1 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:41:50.763865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.765553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '1dca5a2a-236a-433b-af27-004eab6505de'} Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:50.767507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.768688 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.770353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:50.770353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-60f9d7fa-eeba-4276-9ff1-169a8a066069 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 404 len: 111 microversion: 2.1 time: 0.059963 Aug 24 14:41:50.770353 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 468/867] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:41:50 2022] DELETE /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:41:50.783142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.784737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: 1dca5a2a-236a-433b-af27-004eab6505de] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.797040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.798379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.799537 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.801157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.802279 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.803301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.835894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de HTTP/1.1 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:41:50.839337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.845291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '1dca5a2a-236a-433b-af27-004eab6505de'} Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:50.847467 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. Aug 24 14:41:50.850109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:50.852399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance 1dca5a2a-236a-433b-af27-004eab6505de could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:50.852399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1dfd60cb-e706-45f7-b8de-1c501ae56b19 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de" status: 404 len: 111 microversion: 2.1 time: 0.066880 Aug 24 14:41:50.852399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 400/868] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/1dca5a2a-236a-433b-af27-004eab6505de => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:41:51.180111 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.180630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.192672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.193685 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.194509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.196304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.197148 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.198109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.330763 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'services' on Instance uuid 16d03eb9-703e-4e5d-8c06-22f314566c7e {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:51.358775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.363147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.374656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.378186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.379059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.380363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.381468 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.382324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.598763 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:51.616354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:51.620015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:51.622459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c734f3b9-ec0f-40ae-a12a-1f7ef769eeab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1673 microversion: 2.20 time: 0.272576 Aug 24 14:41:51.623711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 401/869] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:51 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:51.656753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9f4eb290-dd39-4e5a-ace8-d1322ed24240 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments/1c1184b2-d4fb-4c90-abf4-3854340b6fce" status: 202 len: 0 microversion: 2.1 time: 0.486060 Aug 24 14:41:51.658120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 469/870] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:41:51 2022] DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments/1c1184b2-d4fb-4c90-abf4-3854340b6fce => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:41:51.673241 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.678641 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.694898 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.695692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.696158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.697790 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.698623 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.699600 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.767359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cb03851b-7b17-40b9-b1c2-536a62e465af tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102528 Aug 24 14:41:51.768501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 402/871] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:51 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:52.300331 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.300924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.308627 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.308862 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.309272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.309978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.310462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.310928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.327493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 HTTP/1.1 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:41:52.329062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.332030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'c0a79bb8-4962-4c32-bafd-b5759bea2607'} Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:52.333626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.336612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.342448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:52.342448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8d4d057b-8243-4cef-bbd0-8e1c05fe2598 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 404 len: 111 microversion: 2.1 time: 0.035740 Aug 24 14:41:52.342448 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 470/872] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:41:52 2022] DELETE /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:41:52.342775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.342775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] [instance: c0a79bb8-4962-4c32-bafd-b5759bea2607] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.349378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.361245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.361245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.361245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.361245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.362747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.370320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] HTTP exception thrown: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Request method failure captured: Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 HTTP/1.1 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcUTTMzDwPBSXRQI4GrMsfx2kMpW1taTqlmCmkKgIQnRXAHiA_bI1-J2WU43S7fCWF2EP3nMsFVonEYFJFM4GrFYM-4jdoBZwsthQfEI4xg_bofk4Pa81r8H8LdBMGnmH0Xl83G9dX-wJeYr_u2HTfruGnUgGRUgqv_iqmXxfFcDyM Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:41:52.372080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d2bc03440f454c15abb4aab9bf6e2374", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d2bc03440f454c15abb4aab9bf6e2374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: d2bc03440f454c15abb4aab9bf6e2374 Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1099300221 Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 7b946ecd87434ad6a00890887d234281 Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeTestJSON-1099300221-project Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.376842 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'c0a79bb8-4962-4c32-bafd-b5759bea2607'} Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:52.378248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. Aug 24 14:41:52.381320 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:41:52.383198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] Returning 404 to user: Instance c0a79bb8-4962-4c32-bafd-b5759bea2607 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:52.383198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-561f5d63-c07f-44ef-89f4-d19a4536ec65 tempest-AttachVolumeTestJSON-1099300221 tempest-AttachVolumeTestJSON-1099300221-project] 10.222.0.49 "GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607" status: 404 len: 111 microversion: 2.1 time: 0.036463 Aug 24 14:41:52.383198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 403/873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:52 2022] GET /compute/v2.1/servers/c0a79bb8-4962-4c32-bafd-b5759bea2607 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:41:52.665246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.665661 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.673796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.674340 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.679318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.679318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.679318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.679318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.783808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.788174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.803113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.806690 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.808103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.809795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.811395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.813155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.924170 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-066a923d-e7c1-4f50-acc1-d23a64d3eb1a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147654 Aug 24 14:41:52.925095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 404/874] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:52 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:52.974931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.988797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.990707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.992867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-074c1c36-1e64-4b0e-abc2-40c149ce3ced tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.337079 Aug 24 14:41:52.993898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 471/875] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:52 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:53.945928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:53.950082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:53.964733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.965658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.966505 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.967848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.968716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.970742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.026363 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.029485 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.038424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5c568131-08b0-4a0f-84ab-c8a1942e81eb tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101352 Aug 24 14:41:54.045153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.046189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 405/876] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 14:41:53 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:41:54.046817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.048627 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.062373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.064694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.065463 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.142023 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.142409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.149750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.150287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.151155 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.151913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.155681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.156219 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.185222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:54.190736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:41:54.269855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.274088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:54.284285 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.286637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.288349 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d85afcda-1dc6-46cc-9280-55f863cb12d6 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.273120 Aug 24 14:41:54.289286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 472/877] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:54.557112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-60a83e2a-8bea-424a-9fa7-13e8f2e55da4 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 204 len: 0 microversion: 2.1 time: 0.419314 Aug 24 14:41:54.558473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 406/878] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:41:54 2022] DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:41:54.576559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.578920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.593531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.595047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.596572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.596572 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.596909 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.597076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.788077 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.799628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-282d4696-a250-4b42-8c5f-e92501570d5c tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1681 microversion: 2.1 time: 0.234776 Aug 24 14:41:54.806738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 473/879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:55.318836 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:55.320126 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:55.328509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.329395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.330020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.331132 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.331750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.332339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.693191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.707072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.709361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.711082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7a363522-4464-4617-96ea-0ee109065e07 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.397277 Aug 24 14:41:55.711967 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 407/880] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:55 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:55.827249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:55.830586 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:55.848952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.850510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.851853 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.853556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.854879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.856036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.122037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:56.137546 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-75e0bf58-427a-4a6a-9112-c59dc3541f0f tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1681 microversion: 2.1 time: 0.317659 Aug 24 14:41:56.139884 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 474/881] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:55 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1681 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:56.739339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.740477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.765401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.767336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.768197 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.769599 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.779294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.780078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.162018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:57.162864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:57.169780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.170592 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.171208 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.172997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.173776 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.174425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.225834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.237389 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.253386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.255119 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e8dfc214-4fa1-4d69-ad43-e8db30be130f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.520552 Aug 24 14:41:57.256493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 408/882] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:57.477011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.502689 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ebdbd1b0-e67a-4ad0-ad86-e3decfbc4d6d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1681 microversion: 2.1 time: 0.344362 Aug 24 14:41:57.518526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 475/883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:57 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1681 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:58.305335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:58.305983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:58.320373 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.321247 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.339966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.341868 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.342915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.344761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.536202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:58.537559 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:58.587594 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.593489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.593489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.593489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.593489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.594678 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.832887 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:58.870341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-eae2e51a-a99f-405e-bc33-2cbf5f963c50 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1614 microversion: 2.1 time: 0.336593 Aug 24 14:41:58.876889 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 476/884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:58 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1614 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:58.926676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d03eb9-703e-4e5d-8c06-22f314566c7e", "name": "network-vif-deleted", "tag": "7247d453-c2a5-4296-9170-64413b60c529"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:58.987035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.987897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.988694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.006662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:59.021939 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:59.023938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:59.025487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f213905f-7ccb-4d6e-866e-1e229c92bdc0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.724303 Aug 24 14:41:59.026677 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 409/885] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:41:58 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:41:59.045008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] Creating event network-vif-deleted:7247d453-c2a5-4296-9170-64413b60c529 for instance 16d03eb9-703e-4e5d-8c06-22f314566c7e on hv-cinder-75670 Aug 24 14:41:59.091904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-56d049b8-5348-42bb-bde9-a3c28fee1b96 req-00f9099a-f74f-4ac0-983d-5fb70c644f17 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210683 Aug 24 14:41:59.094182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 477/886] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:59.922724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:59.925768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:59.941899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.943676 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.945378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.947648 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.949250 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.950822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.076821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:00.080864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:00.100998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.101700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.103875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.110782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.110782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.111153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.112016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.117018 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.125565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.132307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid 16d03eb9-703e-4e5d-8c06-22f314566c7e {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:00.304264 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:00.322023 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-fe59191f-7875-488b-af8d-97d3cef60b35 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1332 microversion: 2.1 time: 0.407791 Aug 24 14:42:00.324020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 410/887] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:59 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1332 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:01.076606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.092750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.101298 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.102970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6d5d9a0e-7086-4cb7-a733-ca94931095e4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 1.038425 Aug 24 14:42:01.103965 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 478/888] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:00 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:01.354434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:01.363052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:01.448188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.459864 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.467625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.470097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.471440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.472680 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.601634 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.603295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.603964 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.604657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lazy-loading 'fault' on Instance uuid 16d03eb9-703e-4e5d-8c06-22f314566c7e {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:01.757646 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b1955a937f4053967cf82cedd87a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e82b68d6da45799b52ce9a6ddaf998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.771738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-89d9daa4-c488-4c36-9c49-3fa4be64cd43 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 200 len: 1332 microversion: 2.1 time: 0.425806 Aug 24 14:42:01.789597 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 411/889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:01 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 1332 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:02.147041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.148662 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.168051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.168801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.169732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.171036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.172701 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.173714 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.453678 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.467338 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.486185 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.494964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ec984b2b-6af4-4944-a13d-da12d4895f7e tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.368778 Aug 24 14:42:02.521060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 479/890] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:02.827639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.829731 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.841483 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.842421 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.843102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.844856 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.864925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.867128 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.888793 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e HTTP/1.1 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:42:02.891955 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:02.899525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '16d03eb9-703e-4e5d-8c06-22f314566c7e'} Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:02.900510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:02.901922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:02.903254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:02.903254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8ae76bfe-41bc-40be-85f9-6cc77a0ee36a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 404 len: 111 microversion: 2.1 time: 0.093836 Aug 24 14:42:02.903254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 412/891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:02.905979 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1e711e2f-6edb-4ae5-9649-9d1b5c189a7e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '.version_select at 0x7f8a8df6d430>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.089748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1e711e2f-6edb-4ae5-9649-9d1b5c189a7e tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819140350" status: 202 len: 0 microversion: 2.1 time: 0.189924 Aug 24 14:42:03.096491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 480/892] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 14:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819140350 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:42:03.546660 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.557310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:03.581454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.582416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.583160 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.584210 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.585286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.585948 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.046091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.083584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.097410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.099850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7162cbce-98a5-453d-80ea-ec5d6838f28f tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.561419 Aug 24 14:42:04.101110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 413/893] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:03 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:04.854986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9d314b7f-da46-4573-a68f-84bd7af5c42e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Action: 'create', calling method: .version_select at 0x7f8a7ff82dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-260769612"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:05.133070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:05.135147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.149217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.150411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.151236 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.152528 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.153750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.154851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.415363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.442508 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.447344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.447344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5e617b40-e340-4c56-b87a-d66233066b34 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.322141 Aug 24 14:42:05.449683 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 414/894] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:05.935237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9d314b7f-da46-4573-a68f-84bd7af5c42e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.342752 Aug 24 14:42:05.936117 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 481/895] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Aug 24 14:42:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1344 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:42:05.961472 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d961334a-dbbc-498d-8006-4d14a9daba6e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7feeadc0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.113627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d961334a-dbbc-498d-8006-4d14a9daba6e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 200 len: 344 microversion: 2.1 time: 0.162031 Aug 24 14:42:06.115929 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 415/896] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:06.192445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.193440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.207965 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.209213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.212477 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.299694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.299694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.299694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.299694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.299694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e HTTP/1.1 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:06.300874 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.303580 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '16d03eb9-703e-4e5d-8c06-22f314566c7e'} Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:06.305427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.308257 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.311112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:06.311112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-379c5f6d-4983-4571-8e83-a279a809974d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 404 len: 111 microversion: 2.1 time: 0.066993 Aug 24 14:42:06.311112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 482/897] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:06 2022] DELETE /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:06.313006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.314158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: 16d03eb9-703e-4e5d-8c06-22f314566c7e] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.325126 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.326031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.329220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.329220 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.330085 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.330834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.366462 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e HTTP/1.1 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:42:06.370662 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.373622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '16d03eb9-703e-4e5d-8c06-22f314566c7e'} Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:06.375718 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. Aug 24 14:42:06.378425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:06.381157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance 16d03eb9-703e-4e5d-8c06-22f314566c7e could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:06.386702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d47db5cf-3b48-4d12-b07f-b630f8cc9e83 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e" status: 404 len: 111 microversion: 2.1 time: 0.077757 Aug 24 14:42:06.393630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 416/898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/16d03eb9-703e-4e5d-8c06-22f314566c7e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:06.491747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.492908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.502444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.503479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.504404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.505500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.506565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.507358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.729655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.747686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.752007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.755253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-80e03963-ae53-47b4-aea7-2f8f957880f3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.270356 Aug 24 14:42:06.757475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 483/899] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:07.137002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-19475b65-2967-4772-975c-933944f755b8 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7fed1040>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:07.217517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-19475b65-2967-4772-975c-933944f755b8 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 200 len: 345 microversion: 2.1 time: 0.079871 Aug 24 14:42:07.217517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 417/900] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:42:07 2022] GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:07.231082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1ba5b6c2-1019-43f0-9acb-9c7f4b232a1e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Action: 'create', calling method: .version_select at 0x7f8a7fffcb80>, body: {"snapshot": {"volume_id": "b692565a-af3b-4283-b2fe-6a3d21c2260a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-81339268"}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:07.804242 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:07.805336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:07.997192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1ba5b6c2-1019-43f0-9acb-9c7f4b232a1e tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.764064 Aug 24 14:42:07.997860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 484/901] 10.222.0.49 () {60 vars in 1162 bytes} [Wed Aug 24 14:42:07 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:08.004102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.004727 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.013683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.014469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.014824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.015867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.016456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.016971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.027404 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.027920 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.028378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.029146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.029624 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.030090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.036107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 HTTP/1.1 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:08.037755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.040599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'd9069459-afe6-441a-ada9-34cd892cb3f0'} Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:08.042330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.045094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.048913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:08.048913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7b5a6846-dace-4e26-ba4f-da04642c96a7 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 404 len: 111 microversion: 2.1 time: 0.040102 Aug 24 14:42:08.048913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 485/902] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:07 2022] DELETE /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:08.048913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3389c99c-f2d5-4785-bcb1-74d799bcf062 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff82b80>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.085813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3389c99c-f2d5-4785-bcb1-74d799bcf062 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.044869 Aug 24 14:42:08.086894 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 486/903] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:08.091584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.092231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: d9069459-afe6-441a-ada9-34cd892cb3f0] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.101116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.101781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.102362 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.103400 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.104036 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.104591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.125047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 HTTP/1.1 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:08.127255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.130590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'd9069459-afe6-441a-ada9-34cd892cb3f0'} Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:08.135345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. Aug 24 14:42:08.138600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.141670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance d9069459-afe6-441a-ada9-34cd892cb3f0 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:08.141670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-34b56550-9424-4cf2-a2bb-f34687836f99 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0" status: 404 len: 111 microversion: 2.1 time: 0.041988 Aug 24 14:42:08.141670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 487/904] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/servers/d9069459-afe6-441a-ada9-34cd892cb3f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:08.144639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-71c94932-02e4-4bce-a271-dd550fcb884c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff82700>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.180772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-71c94932-02e4-4bce-a271-dd550fcb884c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.048337 Aug 24 14:42:08.181497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 488/905] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:08.186775 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.202028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.202028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.202028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.202028 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.203427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.203427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.203427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.215571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 HTTP/1.1 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:08.219777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.222514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'fc4498be-7f58-4211-bb02-944da8aa6c70'} Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:08.224446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.226751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.229097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:08.229097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-83739395-43a7-400a-b044-3b32b6852b13 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 404 len: 111 microversion: 2.1 time: 0.038461 Aug 24 14:42:08.229097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 489/906] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:08 2022] DELETE /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:08.229097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-781a24ba-02fa-4ec6-a183-0e3679b871d0 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff82dc0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.243598 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.261054 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.264558 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.267222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8c92e180-835b-42f2-99a3-a6d2bbcbc741 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.471472 Aug 24 14:42:08.269388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 418/907] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:07 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:08.288696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-781a24ba-02fa-4ec6-a183-0e3679b871d0 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.057450 Aug 24 14:42:08.289663 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.290029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 490/908] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:08.290277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: fc4498be-7f58-4211-bb02-944da8aa6c70] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.292149 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.293506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.294027 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.294806 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.295277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.299110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.311566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 HTTP/1.1 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:42:08.313640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.316452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'fc4498be-7f58-4211-bb02-944da8aa6c70'} Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:08.317917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. Aug 24 14:42:08.320501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.328896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance fc4498be-7f58-4211-bb02-944da8aa6c70 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:08.328896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5833624d-0322-4d31-816d-18d4d707f62a tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70" status: 404 len: 111 microversion: 2.1 time: 0.043820 Aug 24 14:42:08.328896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 419/909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/servers/fc4498be-7f58-4211-bb02-944da8aa6c70 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:09.295064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.295789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:09.302293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-122c8ec9-d85b-4328-9ed0-ff784ad41400 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff4ddc0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.304074 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.304578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.305025 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.305746 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.306244 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.306675 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.335304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-122c8ec9-d85b-4328-9ed0-ff784ad41400 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.037073 Aug 24 14:42:09.341342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 420/910] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:09.457445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.471920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.474913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.477192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e286d2fc-b4d3-450e-9d27-d066a1366591 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.186309 Aug 24 14:42:09.478159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 491/911] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:10.350501 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e568b5a1-bdff-4a83-a0a4-4f9fd66a7985 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7fed14c0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.385850 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e568b5a1-bdff-4a83-a0a4-4f9fd66a7985 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.039430 Aug 24 14:42:10.386918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 421/912] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:10.502753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.503365 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.510728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.511229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.511712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.512479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.512945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.513380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.659877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.669859 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.671416 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.673743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ea438664-b09d-439e-a404-80e33d9572a5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.175827 Aug 24 14:42:10.674427 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 492/913] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:11.403825 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-db1ad007-8593-49a7-ae71-535c9e547b4a tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7feea4c0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:11.457931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-db1ad007-8593-49a7-ae71-535c9e547b4a tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.056289 Aug 24 14:42:11.457931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 422/914] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:11 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:11.701032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:11.701716 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:11.709929 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:11.710783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:11.711732 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:11.712949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:11.713425 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:11.713858 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:11.994265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.994265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.994680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.994680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c9a7a51e-119b-487f-b3eb-ff0bdb003100 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.269111 Aug 24 14:42:11.994680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 493/915] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:11 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:12.473016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2c6f07f2-c01e-4a1f-acdd-19de38551bee tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7fed1430>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.505191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2c6f07f2-c01e-4a1f-acdd-19de38551bee tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 286 microversion: 2.1 time: 0.037048 Aug 24 14:42:12.506215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 423/916] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:12 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:12.521083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-52a8debd-b385-44d8-aacd-9cd70213c465 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a8df6d430>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.892476 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-52a8debd-b385-44d8-aacd-9cd70213c465 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 202 len: 0 microversion: 2.1 time: 0.377973 Aug 24 14:42:12.895764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 494/917] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 24 14:42:12 2022] DELETE /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:42:12.903567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d0f4bfd2-209a-4508-ac3c-37f896777230 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff6d3a0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.949775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d0f4bfd2-209a-4508-ac3c-37f896777230 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 200 len: 285 microversion: 2.1 time: 0.049365 Aug 24 14:42:12.950324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 424/918] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:12 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 285 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:13.021034 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:13.021609 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:13.028663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.029159 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:13.035953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.035953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.035953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:13.035953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.225769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.234947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.236520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.237782 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c33c0e15-cb15-441b-b9fb-09830ca29734 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.221275 Aug 24 14:42:13.238399 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 495/919] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:13 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:13.964182 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f8317921-9ae0-475a-a4c9-3cb8d0a3ee9c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff6d430>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:13.995875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:13.995875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:13.995875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.995875 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:13.997100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.997937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.998918 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.001021 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-f8317921-9ae0-475a-a4c9-3cb8d0a3ee9c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] HTTP exception thrown: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. Aug 24 14:42:14.001898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f8317921-9ae0-475a-a4c9-3cb8d0a3ee9c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Request method failure captured: Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 HTTP/1.1 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBji8QxFZpTUXJ4LIKiCL8BFs5dcAFb3lF13CfLuGYVtZG6BRHRsgq2gSm0zo24tJTdyz4zjvU4mK4wgjeFKDIpCQsAHFQnIepa7BNLV3NQxfk03i6RFqkD8L5if6qUmnT6yzipB21ycJ0RpDw3bOdiNIGFMq8sb_EgeYaF-2x65zvtI Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:42:14.003351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_205a3fd429dd4f56918861c582938551", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/205a3fd429dd4f56918861c582938551"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: e85c39cd135a43f5a9c58b57c25b9872 Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'f07f3e14-1349-4ffc-b0c9-813edccc2b48'} Aug 24 14:42:14.006480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. (HTTP 404) (Request-ID: req-50616240-5ff7-4e4c-a53e-ed5f018027dc) Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.008116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:14.010639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 14:42:14.012946 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f8317921-9ae0-475a-a4c9-3cb8d0a3ee9c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Returning 404 to user: Snapshot f07f3e14-1349-4ffc-b0c9-813edccc2b48 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f8317921-9ae0-475a-a4c9-3cb8d0a3ee9c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48" status: 404 len: 111 microversion: 2.1 time: 0.045310 Aug 24 14:42:14.017063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 425/920] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:42:13 2022] GET /compute/v2.1/os-snapshots/f07f3e14-1349-4ffc-b0c9-813edccc2b48 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:14.019047 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1051ca5b-11db-41a9-bf87-24211638006c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff4d9d0>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.047856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a HTTP/1.1 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:14.051000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.054411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'a9601091-8514-4244-b7ae-a6921fd9fa7a'} Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:14.057107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.060672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.064676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:14.064676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2ad51edf-bbfb-4cf5-a49f-74f1ded47a5d tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 404 len: 111 microversion: 2.1 time: 0.080613 Aug 24 14:42:14.064676 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 496/921] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:13 2022] DELETE /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:14.068354 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.068980 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] [instance: a9601091-8514-4244-b7ae-a6921fd9fa7a] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:14.075895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.076600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.077001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.077966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.079125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.079682 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.095933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] HTTP exception thrown: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Request method failure captured: Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a HTTP/1.1 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcSxZ_A9QvJFGdy5riwShVD6tbU4bQy_lIZjwc7R2VB-dxGZAXhMJC7A3ZDCqaBUBo_Dt6ldQ4oLTDm5n9pl5SnAb3rVsYwTEvpeKdExzrMG2BRbViQ-PMOR_MAz-5ohOrgttJcV56jLkFt43_smYyFadimRbPnJcGw_-Wzvl_XkXU Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:14.101824 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84e82b68d6da45799b52ce9a6ddaf998", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84e82b68d6da45799b52ce9a6ddaf998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 84e82b68d6da45799b52ce9a6ddaf998 Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-865221133 Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 34b1955a937f4053967cf82cedd87a2e Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeNegativeTest-865221133-project Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.104762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'a9601091-8514-4244-b7ae-a6921fd9fa7a'} Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:14.106217 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. Aug 24 14:42:14.108543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:14.111396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] Returning 404 to user: Instance a9601091-8514-4244-b7ae-a6921fd9fa7a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:14.111396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-066988f5-1349-4b6e-bb46-56d4bcc57ec1 tempest-AttachVolumeNegativeTest-865221133 tempest-AttachVolumeNegativeTest-865221133-project] 10.222.0.49 "GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a" status: 404 len: 111 microversion: 2.1 time: 0.037793 Aug 24 14:42:14.111396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 497/922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/servers/a9601091-8514-4244-b7ae-a6921fd9fa7a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:14.266582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.267360 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:14.274385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.274880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.275317 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.276047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.276764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.277173 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.357602 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1051ca5b-11db-41a9-bf87-24211638006c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 202 len: 0 microversion: 2.1 time: 0.346834 Aug 24 14:42:14.358717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 426/923] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:42:14 2022] DELETE /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:42:14.373965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9a559ec0-96ef-40d3-bc94-2e15a3f6d177 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ff4d550>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.447957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9a559ec0-96ef-40d3-bc94-2e15a3f6d177 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 200 len: 344 microversion: 2.1 time: 0.079517 Aug 24 14:42:14.449074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 427/924] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:14.651954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.661890 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.667817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.667817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-23e07778-3c72-4338-94b7-e2a83d8080d8 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.403029 Aug 24 14:42:14.667817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 498/925] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:15.060910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "name": "network-vif-plugged", "status": "completed", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:15.074608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.076713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.076713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.092248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] Creating event network-vif-plugged:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:42:15.098974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-2604ec9b-850b-455d-bb60-bf87c6bee07f req-a64fe8e5-15cd-4545-999b-1a6058745f33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044877 Aug 24 14:42:15.099749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 428/926] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:15.470679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-200537ee-c924-4408-9c66-776c66d17966 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a8df6d430>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-200537ee-c924-4408-9c66-776c66d17966 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] HTTP exception thrown: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-200537ee-c924-4408-9c66-776c66d17966 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Request method failure captured: Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a HTTP/1.1 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBji8QxFZpTUXJ4LIKiCL8BFs5dcAFb3lF13CfLuGYVtZG6BRHRsgq2gSm0zo24tJTdyz4zjvU4mK4wgjeFKDIpCQsAHFQnIepa7BNLV3NQxfk03i6RFqkD8L5if6qUmnT6yzipB21ycJ0RpDw3bOdiNIGFMq8sb_EgeYaF-2x65zvtI Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:15.536312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_205a3fd429dd4f56918861c582938551", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/205a3fd429dd4f56918861c582938551"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: e85c39cd135a43f5a9c58b57c25b9872 Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'b692565a-af3b-4283-b2fe-6a3d21c2260a'} Aug 24 14:42:15.539267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. (HTTP 404) (Request-ID: req-499725ba-04e0-4b60-99ff-41073aa80a87) Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.540947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:15.543252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:42:15.545520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-200537ee-c924-4408-9c66-776c66d17966 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Returning 404 to user: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-200537ee-c924-4408-9c66-776c66d17966 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 404 len: 109 microversion: 2.1 time: 0.075319 Aug 24 14:42:15.549287 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 499/927] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:15.559117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9fa390ad-292e-473d-a6e3-96b3fa205f6c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a7ffb8a60>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.611098 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-9fa390ad-292e-473d-a6e3-96b3fa205f6c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] HTTP exception thrown: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9fa390ad-292e-473d-a6e3-96b3fa205f6c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Request method failure captured: Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a HTTP/1.1 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBji8QxFZpTUXJ4LIKiCL8BFs5dcAFb3lF13CfLuGYVtZG6BRHRsgq2gSm0zo24tJTdyz4zjvU4mK4wgjeFKDIpCQsAHFQnIepa7BNLV3NQxfk03i6RFqkD8L5if6qUmnT6yzipB21ycJ0RpDw3bOdiNIGFMq8sb_EgeYaF-2x65zvtI Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:42:15.615103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_205a3fd429dd4f56918861c582938551", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/205a3fd429dd4f56918861c582938551"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: e85c39cd135a43f5a9c58b57c25b9872 Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'b692565a-af3b-4283-b2fe-6a3d21c2260a'} Aug 24 14:42:15.625966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. (HTTP 404) (Request-ID: req-13d3c3e7-a607-4924-a056-757cf4be7ce5) Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.628104 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:42:15.630608 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:42:15.633372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9fa390ad-292e-473d-a6e3-96b3fa205f6c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Returning 404 to user: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9fa390ad-292e-473d-a6e3-96b3fa205f6c tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 404 len: 109 microversion: 2.1 time: 0.062804 Aug 24 14:42:15.635917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 429/928] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 14:42:15 2022] DELETE /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:15.644561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5635072c-5037-42a5-a472-92a86ae93cf7 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Calling method '.version_select at 0x7f8a8c101310>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.674192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-5635072c-5037-42a5-a472-92a86ae93cf7 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] HTTP exception thrown: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5635072c-5037-42a5-a472-92a86ae93cf7 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Request method failure captured: Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a HTTP/1.1 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBji8QxFZpTUXJ4LIKiCL8BFs5dcAFb3lF13CfLuGYVtZG6BRHRsgq2gSm0zo24tJTdyz4zjvU4mK4wgjeFKDIpCQsAHFQnIepa7BNLV3NQxfk03i6RFqkD8L5if6qUmnT6yzipB21ycJ0RpDw3bOdiNIGFMq8sb_EgeYaF-2x65zvtI Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:42:15.676655 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_205a3fd429dd4f56918861c582938551", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/205a3fd429dd4f56918861c582938551"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/205a3fd429dd4f56918861c582938551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 205a3fd429dd4f56918861c582938551 Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-456408640 Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: e85c39cd135a43f5a9c58b57c25b9872 Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesSnapshotsTestJSON-456408640-project Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'b692565a-af3b-4283-b2fe-6a3d21c2260a'} Aug 24 14:42:15.679829 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. (HTTP 404) (Request-ID: req-d382dc48-d55a-4585-8305-dccc37038a8c) Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.681507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:42:15.686694 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:42:15.689324 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5635072c-5037-42a5-a472-92a86ae93cf7 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] Returning 404 to user: Volume b692565a-af3b-4283-b2fe-6a3d21c2260a could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5635072c-5037-42a5-a472-92a86ae93cf7 tempest-VolumesSnapshotsTestJSON-456408640 tempest-VolumesSnapshotsTestJSON-456408640-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a" status: 404 len: 109 microversion: 2.1 time: 0.043521 Aug 24 14:42:15.693495 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 500/929] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/os-volumes/b692565a-af3b-4283-b2fe-6a3d21c2260a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:15.706734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.706734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:15.706734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:15.714896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.715745 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.716691 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.717848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.721374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.721374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.958006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.974936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.980519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.983144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f886951f-62a4-444d-9669-95589ebf1655 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.296170 Aug 24 14:42:15.984861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 430/930] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:17.026814 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:17.028601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:17.032600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:17.041547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.042383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.043007 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.044473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.045141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.046165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.320022 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.355259 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.358501 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.370551 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a580fc71-e4c8-4c4f-ab83-39bcd5327427 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.350199 Aug 24 14:42:17.383644 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 501/931] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:17 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:18.408835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:18.409912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:18.423440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.436295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.439347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.447400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.447400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.448675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.805412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.822485 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.827029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.829905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b2675650-ae02-4557-86bd-42765bbb48ca tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1731 microversion: 2.20 time: 0.425461 Aug 24 14:42:18.833711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 431/932] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:18 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1731 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:19.888809 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:19.892767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:19.906989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.908484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.909635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.911312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.912597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.913902 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.222412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.240296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.243628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.246403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f03e08fa-7171-49a8-add5-ab71c3a1fdb3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1718 microversion: 2.20 time: 0.367530 Aug 24 14:42:20.248288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 502/933] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:19 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1718 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:59.862585 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:59.864890 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:59.867058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:59.867722 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:59.872861 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:59.874342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:59.874934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:59.875780 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:59.876297 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:59.876723 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:59.912440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-778302ce-b0c9-4ef6-bc48-4bc854dde7c3 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054753 Aug 24 14:42:59.913042 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 432/934] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 14:42:59 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:00.000443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:00.001193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:00.005396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:00.006435 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=99 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:00.013384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.013891 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.015062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.016215 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.016696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.017128 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.046668 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Going to try to terminate instance {{(pid=127922) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:43:00.586384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bb06bcd7-bb38-4be3-95de-87e9d08e637c tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 204 len: 0 microversion: 2.20 time: 0.592345 Aug 24 14:43:00.587343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 503/935] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 14:42:59 2022] DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:43:00.607581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:00.609168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:00.620264 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.620757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.621189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.621965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.622461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.622884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.833823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.843640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.855424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.855424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4a331b6c-d743-4961-ac77-25748cb367ab tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.243923 Aug 24 14:43:00.855424 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 433/936] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:00 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:01.899225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:01.900618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:01.914170 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.915127 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.915997 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:01.917301 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.918175 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.918936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.154631 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:02.164599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:02.166627 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:02.168201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8cffbdf2-c4d9-4bcd-bd33-a39006d06fe4 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.277550 Aug 24 14:43:02.169619 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 504/937] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:01 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:03.212853 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:03.213845 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:03.223232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:03.223921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:03.224531 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:03.225361 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:03.226011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:03.226635 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:03.492915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.502413 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.504071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.505572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bc411d2b-6fc7-42dc-a9d0-89f191ea59c5 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1724 microversion: 2.20 time: 0.296432 Aug 24 14:43:03.506168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 434/938] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:03 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:04.292088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c93ce4-7c64-40f5-92e6-6af373a1c01f", "name": "network-vif-deleted", "tag": "3ba85d54-0046-4a78-a2bc-a109f21d047a"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:04.316900 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.317381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.318070 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.339486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] Creating event network-vif-deleted:3ba85d54-0046-4a78-a2bc-a109f21d047a for instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f on hv-cinder-75670 Aug 24 14:43:04.348748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-cd54459b-1b38-45bb-bee6-c6c9f13a11f7 req-2e10ba7e-1ae5-485f-ae45-a16c252f26b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059898 Aug 24 14:43:04.349893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 505/939] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:04.533101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:04.533742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:04.542159 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.542758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.543269 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.544065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.544622 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.545706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.620258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.630747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.632889 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.634124 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5858a530-03b1-4a7a-a405-df550fd88edc tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1656 microversion: 2.20 time: 0.106001 Aug 24 14:43:04.635344 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 435/940] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:04 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:05.661660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:05.662423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:05.669762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.670695 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.671964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.672641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.673123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.673555 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.717464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.718937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.719510 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.720076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lazy-loading 'fault' on Instance uuid f0c93ce4-7c64-40f5-92e6-6af373a1c01f {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:43:05.768466 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.778839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.780969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c888090dd9f246a79c6be54faf480ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5981da6161ac4717a5b433c31188da53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.782224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-09258f8a-2d88-4a91-9432-6cb0bb450874 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 200 len: 1370 microversion: 2.20 time: 0.125593 Aug 24 14:43:05.782817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 506/941] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:05 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 1370 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:06.806057 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:06.807038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:06.814169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.814863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.815310 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:06.816253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.816709 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.817137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:06.833417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f HTTP/1.1 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:43:06.835169 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:06.838712 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'f0c93ce4-7c64-40f5-92e6-6af373a1c01f'} Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:43:06.840395 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:06.844481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:06.847171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:43:06.847171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0ac76773-1be9-42b0-895a-68ff84fa0b1d tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 404 len: 111 microversion: 2.20 time: 0.035149 Aug 24 14:43:06.847171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 436/942] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:06 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:43:06.853132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-15d63056-5ea1-4a39-8219-c4ef226b5f82 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '.version_select at 0x7f8a7ff828b0>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:06.952791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-15d63056-5ea1-4a39-8219-c4ef226b5f82 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267082290" status: 204 len: 0 microversion: 2.20 time: 0.102968 Aug 24 14:43:06.956734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 507/943] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 14:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267082290 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:43:09.524385 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:09.525137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:09.533077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.533581 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.534039 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.534769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.535224 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.535648 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.552065 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f HTTP/1.1 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:43:09.553950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.555734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'f0c93ce4-7c64-40f5-92e6-6af373a1c01f'} Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:43:09.556681 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.558286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.559792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:43:09.559792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9db3dc1d-36c2-411e-9219-68f838666133 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 404 len: 111 microversion: 2.20 time: 0.035920 Aug 24 14:43:09.559792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 437/944] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 14:43:09 2022] DELETE /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:43:09.568700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:09.569758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: f0c93ce4-7c64-40f5-92e6-6af373a1c01f] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:09.581815 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.582475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.584783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.584783 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.585406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.586168 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.614674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f HTTP/1.1 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:43:09.616702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.619499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'f0c93ce4-7c64-40f5-92e6-6af373a1c01f'} Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:43:09.620388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. Aug 24 14:43:09.621942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:09.624206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance f0c93ce4-7c64-40f5-92e6-6af373a1c01f could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:43:09.624206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f2c71181-dbde-442b-b015-92516cadada0 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f" status: 404 len: 111 microversion: 2.20 time: 0.056356 Aug 24 14:43:09.624206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 508/945] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:09 2022] GET /compute/v2.1/servers/f0c93ce4-7c64-40f5-92e6-6af373a1c01f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:43:11.024064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:11.024870 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:11.036074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.036906 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.037692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.039097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.039950 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.040710 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.063012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 HTTP/1.1 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:43:11.065020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.067930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '3df69832-0c15-4371-b4cd-a5517f6945b3'} Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:43:11.071038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.080569 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.082301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:43:11.082301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7868b507-9fbc-40e1-9fc9-ea00c3ec5f24 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 404 len: 111 microversion: 2.20 time: 0.048226 Aug 24 14:43:11.082301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 438/946] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 14:43:11 2022] DELETE /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:43:11.086130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:11.088460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] [instance: 3df69832-0c15-4371-b4cd-a5517f6945b3] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:11.100696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.101547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.102275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.103201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.103764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.104350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.128006 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] HTTP exception thrown: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Request method failure captured: Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 HTTP/1.1 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjcYSCualiwj_QvxqYk6OFwyAQY1slpCUk1ScOy3e6yDsS6x-3nn372jOGIlGrkeRqUZ4sTKzJWuwYRru28sDuSoCyGtd6DqQzRtOmbyF8_fQilB-McxwWftbi_OXumZuk0czv6j3fxE9eDnYdlnc5SqUu6_t_qqUBsKdQ2QR_fI1gY Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:43:11.131110 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5981da6161ac4717a5b433c31188da53", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5981da6161ac4717a5b433c31188da53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5981da6161ac4717a5b433c31188da53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 5981da6161ac4717a5b433c31188da53 Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-352108408 Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: c888090dd9f246a79c6be54faf480ed9 Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-AttachVolumeShelveTestJSON-352108408-project Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.134098 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '3df69832-0c15-4371-b4cd-a5517f6945b3'} Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:43:11.136218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. Aug 24 14:43:11.139205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:43:11.141911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] Returning 404 to user: Instance 3df69832-0c15-4371-b4cd-a5517f6945b3 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:43:11.141911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e3947282-ffba-4dab-9cc1-4079aae13429 tempest-AttachVolumeShelveTestJSON-352108408 tempest-AttachVolumeShelveTestJSON-352108408-project] 10.222.0.49 "GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3" status: 404 len: 111 microversion: 2.20 time: 0.058097 Aug 24 14:43:11.141911 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 509/947] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:11 2022] GET /compute/v2.1/servers/3df69832-0c15-4371-b4cd-a5517f6945b3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:43:25.051024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:43:25.051643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:43:29.301519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:43:29.302356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:43:57.200200 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1791235888", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:57.214476 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=14 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:57.216163 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=30 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:57.310985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] validate_networks() for None {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:43:57.701978 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:43:57.702422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:43:57.702930 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:43:57.703339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:43:57.703742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:43:57.715742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:57.716250 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:57.716790 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:57.717601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:57.718102 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:57.718533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:57.741708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Getting quotas for project 5b24f59c5d7a45cbb034535eba660e7a. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:43:57.755259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Getting quotas for user 620a40c0e83449a6b39821a589add42c and project 5b24f59c5d7a45cbb034535eba660e7a. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:43:57.767058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:43:57.770036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:43:57.996109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b54ecd9c-a2d0-44ff-ad14-51a2c3498978 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804758 Aug 24 14:43:57.997313 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 439/948] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:43:58.017935 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-05eb3104-20df-4df7-9943-7abff76f209b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:58.019153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-05eb3104-20df-4df7-9943-7abff76f209b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:58.030762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:58.032564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:58.134397 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-05eb3104-20df-4df7-9943-7abff76f209b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:58.150872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-05eb3104-20df-4df7-9943-7abff76f209b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1215 microversion: 2.1 time: 0.141326 Aug 24 14:43:58.151971 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 510/949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:58 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:59.196122 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ad6eba2c-3ebb-4982-92b5-fce46239f2c3 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:59.197252 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ad6eba2c-3ebb-4982-92b5-fce46239f2c3 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:59.296259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ad6eba2c-3ebb-4982-92b5-fce46239f2c3 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:59.304445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ad6eba2c-3ebb-4982-92b5-fce46239f2c3 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1215 microversion: 2.1 time: 0.116451 Aug 24 14:43:59.305402 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 440/950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:59 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:00.345132 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:00.349666 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:00.383663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.389080 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.389912 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.391032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.391948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.392633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.496489 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:00.514754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-05f71371-deb9-481b-b854-3b58a648c91f tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1211 microversion: 2.1 time: 0.177953 Aug 24 14:44:00.516205 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 511/951] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:00 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:01.560529 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:01.576329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:01.576329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.576329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.576329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.577046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.577046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.577046 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.724524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:01.741760 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b97ae557-ac7c-4a9b-9573-c395bec357ab tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1275 microversion: 2.1 time: 0.194022 Aug 24 14:44:01.743788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 441/952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:01 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:02.786843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:02.788905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:02.814747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.816601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.817750 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.820744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.821949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.823096 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.988966 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:03.026920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9e13c311-069c-4306-969f-7153e4c61a27 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1273 microversion: 2.1 time: 0.247756 Aug 24 14:44:03.029291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 512/953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:02 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:04.071113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:04.074600 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:04.128563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:04.130522 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:04.132221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:04.134686 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:04.136648 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:04.147983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:04.462625 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:04.487037 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7d6fd890-94cb-458f-a4db-7e6647c43e76 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.421463 Aug 24 14:44:04.487928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 442/954] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:04 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:05.521693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:05.523220 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:05.542075 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:05.545386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:05.546233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:05.547299 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:05.547942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:05.548663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:05.911452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d23fd6-843b-4af5-bf52-8acbdb434803", "tag": "ba0e089b-40bb-4900-a459-11f6b321c028"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:05.929227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:05.930423 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:05.931113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:05.954431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] Creating event network-changed:ba0e089b-40bb-4900-a459-11f6b321c028 for instance d7d23fd6-843b-4af5-bf52-8acbdb434803 on hv-cinder-75670 Aug 24 14:44:05.961767 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-4a9de5f3-10d5-4bd7-83c3-03ffcbe5af90 req-c831d093-dfb1-44da-8897-4654449958d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054481 Aug 24 14:44:05.963031 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 443/955] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:06.012112 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:06.030728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-3a4cd596-26e2-45d1-b61b-4d72fd7b85af tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.509492 Aug 24 14:44:06.048937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 513/956] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:05 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:07.060212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:07.062043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:07.069694 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.070829 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.071716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.072779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.073482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.074190 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.416134 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:07.431909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ee644124-0a49-48e0-a4b2-2ff4543625cb tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.375300 Aug 24 14:44:07.438181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 444/957] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:07 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:08.460462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:08.461188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:08.463740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:08.470571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.477789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.477789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.477789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.477789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.479031 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.693404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:08.718638 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cb58b558-3620-4fcb-8198-2cec96881648 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.262166 Aug 24 14:44:08.720006 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 514/958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:08 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:09.747815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:09.748963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:09.752658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:09.756511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=8 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:09.765016 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:09.766256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:09.767304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:09.768312 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:09.769292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:09.770120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:10.030038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:10.047841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3b8611ba-3ad5-4516-b006-4ca3bb99b4c2 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.303591 Aug 24 14:44:10.062733 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 445/959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:09 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:11.081522 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:11.082486 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:11.090352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.093356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.093356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.093356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.093356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.093961 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.328496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:11.344307 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2a4f16ad-8183-480f-8f47-14c4c68eca8d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.267346 Aug 24 14:44:11.345305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 515/960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:11 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:12.373162 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:12.373952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:12.393765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.394308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.394957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.395899 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.396555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.397177 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.557942 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d23fd6-843b-4af5-bf52-8acbdb434803", "name": "network-vif-plugged", "status": "completed", "tag": "ba0e089b-40bb-4900-a459-11f6b321c028"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:12.589597 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.593789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.593789 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.615663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] Creating event network-vif-plugged:ba0e089b-40bb-4900-a459-11f6b321c028 for instance d7d23fd6-843b-4af5-bf52-8acbdb434803 on hv-cinder-75670 Aug 24 14:44:12.644941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-179099e7-3663-4842-8365-515072ba9fa3 req-e9517b0d-893f-44be-857b-eea668ec867c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093197 Aug 24 14:44:12.644941 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 516/961] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:12.760577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:12.771749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-668b18a8-95e8-45c2-86e6-9b5aae76c6da tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.404877 Aug 24 14:44:12.772337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 446/962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:12 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:13.799214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:13.800304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:13.812761 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:13.814316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:13.815370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:13.817737 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:13.818562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:13.819607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:14.053442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:14.073753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ae6752f5-ec4e-4e28-ba76-d3c0c7e38830 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.282531 Aug 24 14:44:14.074403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 517/963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:13 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:15.097931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:15.099244 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:15.112938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.113772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.114445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.117356 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.118977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.119678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.448944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:15.460262 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-26e6e499-1967-4839-87fd-6a702955c746 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1315 microversion: 2.1 time: 0.366466 Aug 24 14:44:15.461144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 447/964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:15 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:16.487612 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:16.489045 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:16.499156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.499935 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.500584 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.501522 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.502296 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.502901 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.701508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:16.726722 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0674c499-4de4-4f65-879a-7266847dc98d tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1465 microversion: 2.1 time: 0.245317 Aug 24 14:44:16.727793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 518/965] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:16 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1465 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:16.790856 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:16.795304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:16.811926 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.813194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.813975 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.815280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.816115 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.816874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.884422 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:44:17.274481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-bcf2543d-1671-4524-a0e4-511e05db181b tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 204 len: 0 microversion: 2.1 time: 0.491355 Aug 24 14:44:17.277274 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 448/966] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:44:16 2022] DELETE /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:44:17.286526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:17.287334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:17.296511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.299005 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.305385 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:17.306392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:17.306967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:17.307791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:17.556780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:17.574105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6ced38fd-8962-481c-bc25-38089c851ee5 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1471 microversion: 2.1 time: 0.291437 Aug 24 14:44:17.582462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 519/967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:17 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:18.258644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-205d6f19-d054-419b-a6b1-8465851bec8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Action: 'create', calling method: .version_select at 0x7f8a8c0b0310>, body: {"keypair": {"name": "tempest-TestShelveInstance-997303522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH009cWC2U/Z3WZAOsChZ2fxZebzP2tsfRsXnwCdJJmzLqAdKAzQtxi2xCBrP2OrD4RIFCLI4uG7V0qkNPcfmM9WFYnURvVWKtZEejmhmb/VLkHNb2lzgPsPPZSvQAAlLg=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:18.280061 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-205d6f19-d054-419b-a6b1-8465851bec8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Getting quotas for project d87a7f407bf64c4a9ed59037a569b0a1. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:18.284953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-205d6f19-d054-419b-a6b1-8465851bec8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Getting quotas for user 866e92f9dfb548e1830013af90281362 and project d87a7f407bf64c4a9ed59037a569b0a1. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:18.417603 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-205d6f19-d054-419b-a6b1-8465851bec8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.471057 Aug 24 14:44:18.418970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 449/968] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:44:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:18.612515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:18.613706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:18.626805 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.631712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.631712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.631712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:18.631712 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:18.632411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:18.872747 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:18.882081 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-070691fa-c800-4423-b7aa-04602ef9be68 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1471 microversion: 2.1 time: 0.277400 Aug 24 14:44:18.882768 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 520/969] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:18 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:19.689382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d23fd6-843b-4af5-bf52-8acbdb434803", "name": "network-vif-deleted", "tag": "ba0e089b-40bb-4900-a459-11f6b321c028"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:19.737075 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.737806 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.738634 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.760137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] Creating event network-vif-deleted:ba0e089b-40bb-4900-a459-11f6b321c028 for instance d7d23fd6-843b-4af5-bf52-8acbdb434803 on hv-cinder-75670 Aug 24 14:44:19.770726 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-76cdff2c-4c7c-4c7d-acc8-0478a1d1eb53 req-cd6c9578-6f96-4df1-bbab-3b4a4f7542c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089150 Aug 24 14:44:19.773555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 450/970] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:19.921784 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:19.924404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:19.941030 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.942367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.943534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:19.945176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:19.946530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:19.947954 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:20.063237 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620a40c0e83449a6b39821a589add42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b24f59c5d7a45cbb034535eba660e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:20.076934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-57cce2b9-de54-4009-b415-92873e1c26df tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 200 len: 1300 microversion: 2.1 time: 0.163870 Aug 24 14:44:20.078067 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 521/971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:19 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:21.110766 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:21.111610 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] [instance: d7d23fd6-843b-4af5-bf52-8acbdb434803] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:21.118285 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:21.124445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:21.124445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.124445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:21.124445 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:21.125182 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:21.136729 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] HTTP exception thrown: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Request method failure captured: Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 HTTP/1.1 Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjkqFO0udWYOKNH1cPyMXpFvQz3jJT2TOEC7M_y6mqmRvx6ZA-AiMmxjOvRrORN2M2GCIJgwJ7rFwbp5pYSYNKbchCyjBEwJe3OKcglmdflvcL8xgbJ5gueIZK8i0d5WbGtI84Tw6V95ktgFzvY98dTFZV2yxJaE_Dl1Gk5c02jOcnk Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 5b24f59c5d7a45cbb034535eba660e7a Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-VolumesNegativeTest-1374987162 Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:44:21.139204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b24f59c5d7a45cbb034535eba660e7a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b24f59c5d7a45cbb034535eba660e7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b24f59c5d7a45cbb034535eba660e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b24f59c5d7a45cbb034535eba660e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-VolumesNegativeTest-1374987162 Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 5b24f59c5d7a45cbb034535eba660e7a Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-VolumesNegativeTest-1374987162 Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-VolumesNegativeTest-1374987162-project Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 620a40c0e83449a6b39821a589add42c Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-VolumesNegativeTest-1374987162-project Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. Aug 24 14:44:21.140742 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': 'd7d23fd6-843b-4af5-bf52-8acbdb434803'} Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:44:21.141580 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. Aug 24 14:44:21.142974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:44:21.145212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] Returning 404 to user: Instance d7d23fd6-843b-4af5-bf52-8acbdb434803 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:44:21.145212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6254a234-92f1-4063-85f1-1b02132c4d42 tempest-VolumesNegativeTest-1374987162 tempest-VolumesNegativeTest-1374987162-project] 10.222.0.49 "GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803" status: 404 len: 111 microversion: 2.1 time: 0.036159 Aug 24 14:44:21.145212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 451/972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:21 2022] GET /compute/v2.1/servers/d7d23fd6-843b-4af5-bf52-8acbdb434803 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:44:35.753974 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1189168418", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "networks": [{"uuid": "5dcb932b-8c23-41f4-826a-f32c13e2580e"}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:35.764363 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=26 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:35.765145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=62 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:35.815986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] validate_networks() for [('5dcb932b-8c23-41f4-826a-f32c13e2580e', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:44:36.242123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:44:36.242703 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:44:36.243273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:44:36.243795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:44:36.245635 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:44:36.256041 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.256529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.257008 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.257696 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.258246 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.258672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.279913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Getting quotas for project 094eba75e37c4f5dacca19f83df45066. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:36.284742 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Getting quotas for user b58ceb5012e547baa598b99880901f5e and project 094eba75e37c4f5dacca19f83df45066. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:36.298650 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:44:36.300970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:36.443013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f6da0e9c-261d-4189-875c-4ff7ef64450b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693270 Aug 24 14:44:36.444378 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 522/973] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:44:36.460585 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-74e39fe2-f5f8-40a9-a0cd-209d9ec43747 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:36.461815 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-74e39fe2-f5f8-40a9-a0cd-209d9ec43747 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:36.466410 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:36.467537 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:36.468562 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:36.541912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-74e39fe2-f5f8-40a9-a0cd-209d9ec43747 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:36.550165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-74e39fe2-f5f8-40a9-a0cd-209d9ec43747 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1219 microversion: 2.1 time: 0.096939 Aug 24 14:44:36.550762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 452/974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:36 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:37.572935 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-7e3526b5-b5eb-4b77-b7f2-4840610745d1 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:37.574405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-7e3526b5-b5eb-4b77-b7f2-4840610745d1 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:37.632868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-7e3526b5-b5eb-4b77-b7f2-4840610745d1 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:37.641230 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-7e3526b5-b5eb-4b77-b7f2-4840610745d1 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1219 microversion: 2.1 time: 0.073009 Aug 24 14:44:37.642177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 523/975] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:37 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:38.676617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-23ec9f77-5a2b-4e48-ab23-b02c21e5dd2e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:38.677666 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-23ec9f77-5a2b-4e48-ab23-b02c21e5dd2e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:38.744657 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-23ec9f77-5a2b-4e48-ab23-b02c21e5dd2e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:38.753335 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-23ec9f77-5a2b-4e48-ab23-b02c21e5dd2e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1219 microversion: 2.1 time: 0.081481 Aug 24 14:44:38.754359 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 453/976] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:38 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:39.072558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1424913120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-997303522", "security_groups": [{"name": "tempest-secgroup-smoke-1014700181"}], "networks": [{"uuid": "67a1f0dd-4a06-4b9b-8a19-a1952b1cf9c8"}], "block_device_mapping_v2": [{"uuid": "9e6e9d49-f071-41dc-a95c-7d00c57b5e61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:39.243071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] validate_networks() for [('67a1f0dd-4a06-4b9b-8a19-a1952b1cf9c8', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:44:39.671556 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:44:39.671992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:44:39.672475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:44:39.672885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:44:39.673767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:44:39.683587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.684292 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.684738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.685513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.685960 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.686437 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.705607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Getting quotas for project d87a7f407bf64c4a9ed59037a569b0a1. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:39.710260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Getting quotas for user 866e92f9dfb548e1830013af90281362 and project d87a7f407bf64c4a9ed59037a569b0a1. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:39.774914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:44:39.776777 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e9133ceb-a025-4ab1-a903-90736805a427 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:39.778066 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e9133ceb-a025-4ab1-a903-90736805a427 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:39.778255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e6e9d49-f071-41dc-a95c-7d00c57b5e61',volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:39.853347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e9133ceb-a025-4ab1-a903-90736805a427 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:39.861419 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e9133ceb-a025-4ab1-a903-90736805a427 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1219 microversion: 2.1 time: 0.089783 Aug 24 14:44:39.867110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 454/977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:39 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:40.229108 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-8333442b-6abc-4bda-bbb6-605a84be9fcd tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.160373 Aug 24 14:44:40.229893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 524/978] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:44:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:44:40.241915 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c7790012-9def-4a69-a3b4-0b65454ee44c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:40.242544 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c7790012-9def-4a69-a3b4-0b65454ee44c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:40.322762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c7790012-9def-4a69-a3b4-0b65454ee44c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:40.335881 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c7790012-9def-4a69-a3b4-0b65454ee44c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1088 microversion: 2.1 time: 0.097646 Aug 24 14:44:40.336865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 455/979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:40 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:40.883796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9aa78225-7d5e-49b8-a46f-b81cf97d6085 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:40.884355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9aa78225-7d5e-49b8-a46f-b81cf97d6085 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.085475 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9aa78225-7d5e-49b8-a46f-b81cf97d6085 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:41.094451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9aa78225-7d5e-49b8-a46f-b81cf97d6085 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1219 microversion: 2.1 time: 0.214721 Aug 24 14:44:41.095043 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 525/980] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:40 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:41.360644 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3713f26c-b99e-4a0f-93d2-f1f6359a8d0d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:41.361653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3713f26c-b99e-4a0f-93d2-f1f6359a8d0d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.429503 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3713f26c-b99e-4a0f-93d2-f1f6359a8d0d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:41.437909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3713f26c-b99e-4a0f-93d2-f1f6359a8d0d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1088 microversion: 2.1 time: 0.084199 Aug 24 14:44:41.438560 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 456/981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:41 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:42.120705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:42.122247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:42.134952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.135736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.137837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.139000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.139665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.140436 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.234503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.242965 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5a288d10-7aef-4326-b381-aa8d131bd949 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1223 microversion: 2.1 time: 0.129675 Aug 24 14:44:42.243576 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 526/982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:42 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:42.466059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:42.467000 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:42.476643 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.477334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.477965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.478922 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:42.481352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:42.482428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.571812 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.582078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-318efd5f-3c6e-4187-8635-bd6447af4807 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1186 microversion: 2.1 time: 0.121436 Aug 24 14:44:42.582671 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 457/983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:42 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1186 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:43.266845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.267752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.274571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.276613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.276613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.276613 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.277498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.277498 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.366583 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:43.381221 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-da552146-94f6-4781-9738-42beed8d140b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1271 microversion: 2.1 time: 0.118294 Aug 24 14:44:43.384318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 527/984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:43.607111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.608392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.618226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.619092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.619784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.620752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.621806 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.622481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.779073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:43.791996 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-44c2225c-85fb-48ea-9b78-187572823e52 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1204 microversion: 2.1 time: 0.190044 Aug 24 14:44:43.808019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 458/985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1204 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:44.424924 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:44.426131 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:44.437053 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.437813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.438426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.439266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.439839 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.440624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.521851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:44.532462 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-448d9175-e3d0-4f8a-b7d3-7fa53d7cee09 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1277 microversion: 2.1 time: 0.113650 Aug 24 14:44:44.533143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 528/986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:44 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:44.826162 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:44.827513 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:44.835525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.836022 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.836464 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.837194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.837806 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.838304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.053970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:45.064147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8fd09ce1-f0cf-4756-858d-0ba0d97cc9b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1204 microversion: 2.1 time: 0.242812 Aug 24 14:44:45.065006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 459/987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:44 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1204 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:45.566097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:45.566097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:45.580170 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.580998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.581459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.582327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.582804 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.583235 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.796375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:45.806781 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d4c1964b-4ba0-409a-b29c-3d28ac2525bc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.250026 Aug 24 14:44:45.807717 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 529/988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:45 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:46.090372 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:46.091135 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:46.098116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.098779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.099213 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.099942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.100407 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.100837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.742277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.751290 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-acb8b4a8-dcc8-48d8-8618-8d43f64548b5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.665988 Aug 24 14:44:46.751904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 460/989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:46 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:46.829239 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:46.829878 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:46.841022 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.841770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.842382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.843255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:46.843819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:46.844375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:46.989258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:47.000334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ea03720f-aa91-4d68-8913-9902bee65ea2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.175262 Aug 24 14:44:47.001107 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 530/990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:46 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:47.545401 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:47.556218 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.556907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.557341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.574618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] Creating event network-changed:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:44:47.578864 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-1f54e35f-0b09-4aa2-8eb4-dced1b8807ed req-23c7113b-6362-4cb1-9ee3-506494583b24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038445 Aug 24 14:44:47.579502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 461/991] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:47.780128 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:47.781218 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:47.794603 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.795565 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.796403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:47.797803 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:47.798740 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:47.799677 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.014755 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:48.024308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5a2b2a55-4042-4e48-893a-3074564fdf63 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.253175 Aug 24 14:44:48.024904 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 531/992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:47 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:48.029658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:48.030794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:48.040191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.040695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.041394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.043043 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:48.044187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:48.044639 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:48.689469 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:48.702857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-902746b8-385f-41ab-ad0d-16864639f816 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.680752 Aug 24 14:44:48.704136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 462/993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:48 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:49.050094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:49.051692 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:49.057846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.059632 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.060080 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.060785 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.061249 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.061673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.200950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:49.206562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2bcdad97-ddbc-469d-8281-3582da3c870e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.160320 Aug 24 14:44:49.207145 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 532/994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:49 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:49.602195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79bc68c-4b79-4ab5-9cc3-3ac10052d955", "tag": "d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:49.612327 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.612835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.613271 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.625874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] Creating event network-changed:d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a for instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 on hv-cinder-75670 Aug 24 14:44:49.631409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-6ef59dfe-9772-4bb7-b37f-879f4d615c4e req-9fff79b3-d949-457d-ab1d-9e5aef1df3d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033466 Aug 24 14:44:49.632020 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 463/995] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:49.728863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:49.729606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:49.732771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=4 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:49.738554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.739138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.739581 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.744290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:49.744290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:49.744290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:49.893414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:49.902410 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4566d64e-b68e-4a46-a0c2-0d9dc10706d3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.177250 Aug 24 14:44:49.903087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 533/996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:49 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:50.231316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:50.232077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:50.238902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.239406 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.239851 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.240572 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.241113 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.241605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.440465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:50.449614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dc16b09f-8e80-48c4-8191-440290539345 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.223901 Aug 24 14:44:50.449614 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 464/997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:50 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:50.925062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:50.925693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:50.932570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.934297 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.934788 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.935532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.936004 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.936444 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.084880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.093881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f8ddb3f7-826d-4858-8104-a3fddbbf1b6b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.173130 Aug 24 14:44:51.094529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 534/998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:50 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:51.472448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:51.473095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:51.475607 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=10 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:51.481798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.482374 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.482854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.483798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:51.484365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:51.484839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:51.644342 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.653762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ce2a732f-db12-4f1c-aaba-61e8053605f7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.185109 Aug 24 14:44:51.654450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 465/999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:51 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:52.120094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.121345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.124819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=16 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:52.135474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.136346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.141895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.141895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.141895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.141895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.301017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:52.312964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bfad64ea-2a0d-44f4-adaa-a616d40d1bd3 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.200090 Aug 24 14:44:52.313907 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 535/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:52.676574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.677437 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.685761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.686532 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.686979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.687738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:52.688206 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:52.688669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:52.845541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:52.855188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ffd6f249-04d6-4ced-a601-3b208e25f6ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.183062 Aug 24 14:44:52.855794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 466/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:53.335702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:53.336368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:53.343097 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.343605 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.344047 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.344786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.345247 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.345679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.503628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:53.512790 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-dca1ab70-8d5c-4d3a-a8d0-0af220a8f0c0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.181343 Aug 24 14:44:53.513392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 536/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:53 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:53.878745 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:53.880167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:53.887150 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.887728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.888170 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.888903 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.889365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.889798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.056741 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:54.067865 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0bee2c76-a0e4-496d-bbb3-309d490fb828 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.194527 Aug 24 14:44:54.068477 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 467/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:53 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:54.161621 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79bc68c-4b79-4ab5-9cc3-3ac10052d955", "name": "network-vif-plugged", "status": "completed", "tag": "d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:54.183599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.184445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.185123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.201488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] Creating event network-vif-plugged:d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a for instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 on hv-cinder-75670 Aug 24 14:44:54.234407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-937948f1-7c9c-4eed-bdab-4d675adf91ef req-e734fb6d-0f64-4491-a3fb-3a2e40d0227d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054605 Aug 24 14:44:54.234407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 537/1004] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:54.535347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:54.536392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:54.544454 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.545025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.545627 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.546539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.547312 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.548049 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.788768 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:54.799650 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c2a740a0-24e9-4bf0-a1cc-507042d90c1e tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.268366 Aug 24 14:44:54.800896 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 468/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:54 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:55.090821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:55.091527 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:55.097951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.098492 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.098933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.099659 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.100120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.100543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.255267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:55.270183 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9d56f5d4-564b-4cf3-8f01-6fdfa750a4a3 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.184398 Aug 24 14:44:55.274409 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 538/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:55 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:55.837143 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:55.837795 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:55.845702 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.846230 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.846670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.847387 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.847848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.848275 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.000612 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.015318 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d2463a77-9512-4d0b-a63a-635bec037a11 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1319 microversion: 2.1 time: 0.181898 Aug 24 14:44:56.016397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 469/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:55 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:56.294810 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:56.295948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:56.307414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.308328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.309537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.310873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.311705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.312469 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.516141 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.525777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-904e1dd8-ce2a-478e-a2d7-71ca90d9dcba tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.238177 Aug 24 14:44:56.527122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 539/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:56 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:57.037885 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.038509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.046459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.046958 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.047397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.048111 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.048567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.048991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.205925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.215146 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dbb0f605-cc45-4c5b-ab8d-9180f96c56ff tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1507 microversion: 2.1 time: 0.181739 Aug 24 14:44:57.215962 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 470/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:57.553138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.553981 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.561736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.562539 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.563236 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.564082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.564653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.565380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.726455 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.736089 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-64804598-9827-444a-bc3a-a148d0a53479 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.190752 Aug 24 14:44:57.736702 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 540/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:58.771178 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:58.801772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:58.801772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.801772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.801772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.803183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.803183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.803183 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.000179 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:59.016084 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66457449-18fe-419f-9cc4-7e05441f97bb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.250588 Aug 24 14:44:59.017194 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 471/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:58 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:00.059681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:00.061182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:00.073792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.074677 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.075454 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.076751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.077595 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.078377 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.153307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "name": "network-vif-plugged", "status": "completed", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:00.168109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.168596 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.169114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.181722 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] Creating event network-vif-plugged:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:45:00.188459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-e1072022-c8ec-4f6c-b6b3-8d21af3246bd req-a56ff7a7-e06c-40f7-80e6-9417aef2e9e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039447 Aug 24 14:45:00.190382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 472/1012] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:00.316373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:00.346744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d27aa408-0c3f-4a47-8f3c-ec7efcc0ddeb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.295384 Aug 24 14:45:00.366338 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 541/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:00 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.386133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.387217 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.394807 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.395443 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.395981 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.396796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.397367 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.397890 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.574141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:01.584000 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f0a557f0-cf3f-47c8-9182-33a3d29bef6d tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1260 microversion: 2.1 time: 0.203250 Aug 24 14:45:01.585053 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 473/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:01 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:02.611135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.611756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.619513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.619970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.622464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.623336 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.623931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.624423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.647368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=100 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:02.790441 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:02.800402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a8dd3ed6-2d64-4b02-a7c6-da691cfcd83b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1443 microversion: 2.1 time: 0.193442 Aug 24 14:45:02.801182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 542/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1443 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:02.822052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.822942 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.830583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.831078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.831519 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.832255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.832719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.833145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.015139 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:03.023667 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ae313e3b-b37d-4153-8bd7-88ad66d5151a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1443 microversion: 2.1 time: 0.205910 Aug 24 14:45:03.024289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 474/1016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1443 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:05.791062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:05.799315 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:05.803849 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.804342 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.804775 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.829801 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] Creating event network-changed:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:45:05.840648 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-fbac25ee-ec1a-4475-85bc-899492135139 req-429f29d8-c8c4-4b8b-b679-5586fd809582 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052929 Aug 24 14:45:05.843248 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 543/1017] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:14.322357 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d8f91f1-f808-4c29-9079-9df5906782ff", "device": "/dev/sdb"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:14.325620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:14.329145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=56 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:14.329874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=96 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:14.335171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.335673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.336112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:14.336833 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.337304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.337725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:15.316378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c6f76b8f-6c42-4e46-bcc5-3fd427e9cc03 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "POST /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998021 Aug 24 14:45:15.317028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 475/1018] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:45:14 2022] POST /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:41.196343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:41.203266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:41.203266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=4 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:41.206352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:41.206854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:41.207295 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:41.208020 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:41.208478 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:41.208908 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:41.304976 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lazy-loading 'services' on Instance uuid a79bc68c-4b79-4ab5-9cc3-3ac10052d955 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:41.676497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e70475e5-9dfb-4742-8bdb-a2037fe20edc tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955/os-volume_attachments/4d8f91f1-f808-4c29-9079-9df5906782ff" status: 202 len: 0 microversion: 2.1 time: 0.484672 Aug 24 14:45:41.677187 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 544/1019] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:45:41 2022] DELETE /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955/os-volume_attachments/4d8f91f1-f808-4c29-9079-9df5906782ff => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:45:42.823319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:42.828277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:42.832837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:42.833927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:42.845465 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:42.846045 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:42.846563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:42.847370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:42.847876 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:42.848452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:42.879816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:43.466649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-439fbd92-f2e5-4e6d-9cae-98b944bd7a10 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 204 len: 0 microversion: 2.1 time: 0.644529 Aug 24 14:45:43.468963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 476/1020] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:45:42 2022] DELETE /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:43.481675 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:43.482910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:43.493819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.497743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.497743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.497743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.497743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.498359 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.663290 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:43.672928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e32b80ac-9b61-4c0c-8658-852b29202d95 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1513 microversion: 2.1 time: 0.199981 Aug 24 14:45:43.673532 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 545/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:43 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:44.696602 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:44.697304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:44.704952 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.705502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.706002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.706928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.707439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.707909 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.863239 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:44.872534 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e8b1ca29-7339-4189-b071-36a96d3d050b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1513 microversion: 2.1 time: 0.180471 Aug 24 14:45:44.873139 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 477/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:44 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:45.895245 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:45.895992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:45.904178 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.904672 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.905327 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:45.906094 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.906561 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.906995 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:45.984147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:45.999391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-180123d4-65d4-40a9-a580-dca7b58c4c24 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 200 len: 1471 microversion: 2.1 time: 0.108041 Aug 24 14:45:46.000272 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 546/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:45 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:46.001689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79bc68c-4b79-4ab5-9cc3-3ac10052d955", "name": "network-vif-deleted", "tag": "d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:46.012835 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.013329 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.013750 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.026382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] Creating event network-vif-deleted:d3ccd2e3-9c34-4cb6-bb5b-06d5490af47a for instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 on hv-cinder-75670 Aug 24 14:45:46.032543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-b5d12baa-112f-4bc0-b124-b0dbac49f68d req-10a400e7-85f5-4a41-8f8b-ccd46b3d9db6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110583 Aug 24 14:45:46.033706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 478/1024] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:47.024944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:47.026102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: a79bc68c-4b79-4ab5-9cc3-3ac10052d955] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:47.032806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.033335 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.033882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.034616 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.035083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.035514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.051497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] HTTP exception thrown: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Request method failure captured: Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 HTTP/1.1 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjlRLoOsjeDvSO5axxnS3XBOn7qaRi_VmrSn5vWmjGRx7_QUMj4W2imu1gYwtbJ1Df56V6qbTbMK-217Pm_0yXTNGVY3XGrj_Qwh4SbYDMBbddzCcq0Kbh1iCpJq8_fdJmJr2DfSL1AUUoFHi-ZwrB5602BMcGU5KA8BAGVin5SR_C8 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 094eba75e37c4f5dacca19f83df45066 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:45:47.053266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_094eba75e37c4f5dacca19f83df45066", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 094eba75e37c4f5dacca19f83df45066 Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesSnapshotTestJSON-1774164024-project Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: b58ceb5012e547baa598b99880901f5e Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesSnapshotTestJSON-1774164024-project Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. Aug 24 14:45:47.054846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'a79bc68c-4b79-4ab5-9cc3-3ac10052d955'} Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:47.055726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. Aug 24 14:45:47.058711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:45:47.061759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Returning 404 to user: Instance a79bc68c-4b79-4ab5-9cc3-3ac10052d955 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:47.061759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fe3b5bf5-7719-49f9-b9fd-6c8775f29cc0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955" status: 404 len: 111 microversion: 2.1 time: 0.034181 Aug 24 14:45:47.061759 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 547/1025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:47 2022] GET /compute/v2.1/servers/a79bc68c-4b79-4ab5-9cc3-3ac10052d955 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:45:56.733652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:56.734461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:56.738788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1974421105", "imageRef": "c17a3996-d178-4945-a02b-e071e819103c", "flavorRef": "452", "networks": [{"uuid": "5dcb932b-8c23-41f4-826a-f32c13e2580e"}]}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:56.800669 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] validate_networks() for [('5dcb932b-8c23-41f4-826a-f32c13e2580e', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:45:57.213090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:45:57.213090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:45:57.213090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:45:57.213090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:45:57.213090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:45:57.227510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.228051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.228499 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.229249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.229711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.230188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.251773 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Getting quotas for project 094eba75e37c4f5dacca19f83df45066. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:45:57.258486 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Getting quotas for user b58ceb5012e547baa598b99880901f5e and project 094eba75e37c4f5dacca19f83df45066. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:45:57.270579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:45:57.273032 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17a3996-d178-4945-a02b-e071e819103c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:45:57.500588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7c11baaa-a362-4cab-b7a8-7a2aee6d64d9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768206 Aug 24 14:45:57.501156 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 479/1026] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:45:57.517274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c77d235c-425e-4759-9ae9-8da7dd159f98 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:57.520479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c77d235c-425e-4759-9ae9-8da7dd159f98 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:57.520479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=9 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:57.521339 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:57.591711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c77d235c-425e-4759-9ae9-8da7dd159f98 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:57.605814 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c77d235c-425e-4759-9ae9-8da7dd159f98 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1219 microversion: 2.1 time: 0.092378 Aug 24 14:45:57.608288 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 548/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:57 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:58.640546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:58.641323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:58.654953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.656349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.657142 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.658440 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.659221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.659931 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.737392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:58.746882 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-8a3779e2-aff1-4106-9e02-6584f77b8337 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1223 microversion: 2.1 time: 0.111070 Aug 24 14:45:58.747762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 480/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:58 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:59.769558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:59.770241 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:59.778973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.779471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.779913 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.780633 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.781291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.781724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.858314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:59.866627 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-70d7000b-bc5f-4ccf-a8e7-4af32d09f10a tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1271 microversion: 2.1 time: 0.101321 Aug 24 14:45:59.869828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 549/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:59 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:00.899600 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:00.901175 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:00.909121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.909701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.910299 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:00.911048 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.911507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.911935 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:01.091752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:01.099983 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f21b9be7-53d9-472b-bc5f-f9555514b921 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.205244 Aug 24 14:46:01.100628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 481/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:00 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:02.100406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76dc7abc-3670-4924-9e35-548c73cd5952", "tag": "e639d61b-b589-4d03-a70e-668dcb11d5b2"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:02.132474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.132474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.132474 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.139752 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:02.141095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:02.150989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.151957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.152135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] Creating event network-changed:e639d61b-b589-4d03-a70e-668dcb11d5b2 for instance 76dc7abc-3670-4924-9e35-548c73cd5952 on hv-cinder-75670 Aug 24 14:46:02.153083 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.154380 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.155530 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.156482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.159777 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-d910c37d-e463-4dce-973a-ed03172c21b4 req-34fe3a13-9ddc-4c8c-a144-191e44fc7c66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066531 Aug 24 14:46:02.161017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 550/1031] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:02.429963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:02.440540 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-11c3306f-5f6f-4d20-b87f-1b233cbc1555 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.309110 Aug 24 14:46:02.441301 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 482/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:02 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:03.475863 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:03.476564 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:03.484057 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.484550 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.484988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.485700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.486191 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.486617 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.637554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:03.645678 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2d41e98c-cd8b-482e-9fab-5a9c0c3cf7bb tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.174380 Aug 24 14:46:03.646316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 551/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:03 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:04.668299 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:04.668866 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:04.675409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.675893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.676328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.677028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.677481 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.677901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.849034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:04.857827 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-dea50526-e918-423b-a7a1-6b4166e4db66 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.194417 Aug 24 14:46:04.858456 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 483/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:04 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:05.880291 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:05.880998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:05.888536 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.889070 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.889515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.890387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.890751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.891188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:06.053756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:06.063739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9ffa01a0-c4d9-4376-b9ee-17412b282d6f tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.187661 Aug 24 14:46:06.064418 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 552/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:05 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:07.086180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:07.086971 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:07.094408 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.094913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.095363 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.096114 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.096550 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.096989 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.239637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:07.259028 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.266054 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=6 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:07.269002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9390cd6b-3021-43ec-99d2-518acd73d5d2 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.187530 Aug 24 14:46:07.269617 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 484/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:07 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:08.302231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:08.303105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:08.306451 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:08.312352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.312898 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.313387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.314258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.314855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.315442 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.512280 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:08.521983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a1c4d623-4969-49e5-989c-46e4c6e6b3b0 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.223975 Aug 24 14:46:08.522693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 553/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:08 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:08.846426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76dc7abc-3670-4924-9e35-548c73cd5952", "name": "network-vif-plugged", "status": "completed", "tag": "e639d61b-b589-4d03-a70e-668dcb11d5b2"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:08.858154 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.861166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.861166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.873198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] Creating event network-vif-plugged:e639d61b-b589-4d03-a70e-668dcb11d5b2 for instance 76dc7abc-3670-4924-9e35-548c73cd5952 on hv-cinder-75670 Aug 24 14:46:08.879295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-69626215-8be4-47b1-b92a-504905739312 req-677ea1c2-a86b-45d3-bf02-1d62ecd25662 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109912 Aug 24 14:46:08.879941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 485/1038] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:09.546414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:09.547197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:09.554601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.555261 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.556369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.557973 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.558529 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.558934 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.717133 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:09.727636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2003a4a0-adb9-4e18-870c-bc214c8a11ec tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.185018 Aug 24 14:46:09.729352 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 554/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:09 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:10.752226 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:10.752884 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:10.760144 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.760651 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.761110 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.761843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.762340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.762776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.924541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:10.934817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-64b66c28-8127-4c6b-89c6-a4c0c8936412 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1319 microversion: 2.1 time: 0.187711 Aug 24 14:46:10.939767 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 486/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:10 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:11.956248 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:11.956888 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:11.964443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.964940 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.965379 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.966138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.966599 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.967023 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.117706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:12.126879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6f0bd7ab-207b-48c4-a877-a60c36c4528b tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1507 microversion: 2.1 time: 0.174397 Aug 24 14:46:12.127485 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 555/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:11 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:12.163214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f919eeb4-baaf-4010-87d9-ea6e1bc27d3a", "device": "/dev/sdb"}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:12.166362 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:12.173293 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.173784 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.174261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.174982 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.175439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.175863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.068738 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1a575bda-4744-4fb3-a095-29006860b95c tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "POST /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909474 Aug 24 14:46:13.069805 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 487/1042] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 14:46:12 2022] POST /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:33.398086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:33.398780 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:33.401052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=18 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:33.401724 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=38 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:33.406876 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:33.407370 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:33.407809 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:33.408531 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:33.408991 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:33.409418 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:33.515986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lazy-loading 'services' on Instance uuid 76dc7abc-3670-4924-9e35-548c73cd5952 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:33.829189 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fb89fcd7-cb39-469b-a579-223f408db799 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952/os-volume_attachments/f919eeb4-baaf-4010-87d9-ea6e1bc27d3a" status: 202 len: 0 microversion: 2.1 time: 0.435178 Aug 24 14:46:33.829922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 556/1043] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 14:46:33 2022] DELETE /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952/os-volume_attachments/f919eeb4-baaf-4010-87d9-ea6e1bc27d3a => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:46:36.068379 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:36.069001 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:36.072382 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:36.073137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:36.079112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.082966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.082966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.082966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.082966 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.083775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.111979 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:36.497297 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f6d60c63-b88f-4d23-b94e-87f1abcf8afa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 204 len: 0 microversion: 2.1 time: 0.432734 Aug 24 14:46:36.498388 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 488/1044] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:36 2022] DELETE /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:46:36.508743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:36.509707 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:36.516817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.517326 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.517770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.518686 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.519147 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.519585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.668314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:36.676730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-87cfcdc0-ade2-42cb-8b63-0c722fbb7804 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1513 microversion: 2.1 time: 0.173101 Aug 24 14:46:36.677346 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 557/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:36 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:37.700196 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:37.700823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:37.707675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:37.708163 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:37.708591 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:37.709708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:37.710538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:37.711642 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:37.863783 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:37.872978 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-be80b8f0-9339-4bc3-b643-8b154e712372 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1513 microversion: 2.1 time: 0.177465 Aug 24 14:46:37.873588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 489/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:37 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:38.784588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76dc7abc-3670-4924-9e35-548c73cd5952", "name": "network-vif-deleted", "tag": "e639d61b-b589-4d03-a70e-668dcb11d5b2"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:38.796813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.797311 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.797752 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.815267 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] Creating event network-vif-deleted:e639d61b-b589-4d03-a70e-668dcb11d5b2 for instance 76dc7abc-3670-4924-9e35-548c73cd5952 on hv-cinder-75670 Aug 24 14:46:38.817817 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-5ffc2639-e243-4b9a-b404-c5f2efd18eed req-57929f76-4799-4915-9045-7d6f6b1f5b6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037025 Aug 24 14:46:38.818714 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 558/1047] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:38.896073 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:38.896721 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:38.903888 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.904377 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.904808 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.905525 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.905980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.906427 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.992233 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58ceb5012e547baa598b99880901f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094eba75e37c4f5dacca19f83df45066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:39.002692 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-faf48b48-5a80-4970-b2b6-f6c76ec131aa tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 200 len: 1304 microversion: 2.1 time: 0.110487 Aug 24 14:46:39.003584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 490/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:38 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:40.026949 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:40.027992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] [instance: 76dc7abc-3670-4924-9e35-548c73cd5952] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:40.035503 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.036018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.036465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:40.037200 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.037665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.038137 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:40.054170 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] HTTP exception thrown: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Request method failure captured: Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 HTTP/1.1 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjlRLoOsjeDvSO5axxnS3XBOn7qaRi_VmrSn5vWmjGRx7_QUMj4W2imu1gYwtbJ1Df56V6qbTbMK-217Pm_0yXTNGVY3XGrj_Qwh4SbYDMBbddzCcq0Kbh1iCpJq8_fdJmJr2DfSL1AUUoFHi-ZwrB5602BMcGU5KA8BAGVin5SR_C8 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 094eba75e37c4f5dacca19f83df45066 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:46:40.062305 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_094eba75e37c4f5dacca19f83df45066", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/094eba75e37c4f5dacca19f83df45066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 094eba75e37c4f5dacca19f83df45066 Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1774164024 Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-VolumesSnapshotTestJSON-1774164024-project Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: b58ceb5012e547baa598b99880901f5e Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-VolumesSnapshotTestJSON-1774164024-project Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. Aug 24 14:46:40.065423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '76dc7abc-3670-4924-9e35-548c73cd5952'} Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:40.067637 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. Aug 24 14:46:40.070601 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:46:40.074213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] Returning 404 to user: Instance 76dc7abc-3670-4924-9e35-548c73cd5952 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:40.074213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6674eb89-17a3-4caa-85cb-4fd9d6b50cf9 tempest-VolumesSnapshotTestJSON-1774164024 tempest-VolumesSnapshotTestJSON-1774164024-project] 10.222.0.49 "GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952" status: 404 len: 111 microversion: 2.1 time: 0.038108 Aug 24 14:46:40.074213 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 559/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:40 2022] GET /compute/v2.1/servers/76dc7abc-3670-4924-9e35-548c73cd5952 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:45.061287 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:46:45.062227 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:47:13.860683 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:13.861429 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:13.863315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:13.863980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:13.869735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:13.870246 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:13.870678 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:13.871394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:13.871848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:13.872263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:13.897944 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.objects.instance [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lazy-loading 'flavor' on Instance uuid 1eac4cbf-bb64-41d9-83f2-7e93da38c01b {{(pid=127923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:14.298158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cce30667-3f4d-4584-9b5f-ba1c3b36c0f1 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "POST /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b/action" status: 202 len: 0 microversion: 2.1 time: 0.441277 Aug 24 14:47:14.298837 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 491/1050] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:13 2022] POST /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:47:14.309000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:14.309795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:14.312182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=8 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:14.312854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:14.317838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:14.318373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:14.318816 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:14.319754 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:14.320355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:14.320815 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:14.506796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:14.516214 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-12787f9e-49d3-4a3d-a815-0bb0ada381fa tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.212030 Aug 24 14:47:14.516818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 560/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:14 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:15.542281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:15.543007 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:15.551149 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:15.551649 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:15.552165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:15.552900 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:15.553365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:15.553796 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:16.012605 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:16.021323 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c13a487f-1810-444c-814c-8a5803443c85 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.485134 Aug 24 14:47:16.022011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 492/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:15 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:17.055534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:17.056176 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:17.063813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:17.064313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:17.064756 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:17.065484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:17.065946 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:17.066407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:17.216881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:17.225332 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ac6b88f0-2dad-4a1a-a92c-0cad375a6014 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.174006 Aug 24 14:47:17.226579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 561/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:17 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:18.248337 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:18.249030 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:18.256319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.257823 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.258306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.259040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.259505 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.259936 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.421249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:18.431012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-94c0a5c3-8bf5-4af3-b8ca-ac2e63d3ec11 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.186484 Aug 24 14:47:18.431686 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 493/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:18 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:19.452893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:19.453459 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:19.460906 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.461402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.461948 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:19.462994 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.463456 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.464143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:19.664223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:19.674320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0dff1433-c931-4f96-8b2e-b81c04be61ad tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.225171 Aug 24 14:47:19.677656 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 562/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:19 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:20.698548 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:20.699148 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:20.705745 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:20.706280 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:20.706724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:20.707432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:20.707891 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:20.708338 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:20.870628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:20.879078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a7529de9-6509-4964-a75b-b4ee240b599e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.185264 Aug 24 14:47:20.883988 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 494/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:20 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:21.901956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:21.902706 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:21.909432 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:21.909922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:21.910392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:21.911103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:21.911562 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:21.911988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:22.057523 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:22.066520 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ff6853e2-f107-42c7-9e77-518206fb3334 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.169365 Aug 24 14:47:22.067265 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 563/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:21 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:23.093103 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:23.093751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:23.100383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:23.101212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:23.101754 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:23.102508 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:23.102970 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:23.103434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:23.267583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:23.276507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-9c207989-7e55-4d61-aa52-ec9e24c696e7 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.187217 Aug 24 14:47:23.281582 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 495/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:23 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:24.307772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:24.308446 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:24.315435 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.315944 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.316392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.317202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.317682 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.318164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.479384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:24.493769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-0230daf2-cf73-4edd-a43d-f1e342153476 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.190627 Aug 24 14:47:24.494883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 564/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:24 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:25.529986 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:25.530636 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:25.537696 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.538775 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.539209 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.539937 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.540396 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.540822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.747988 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:25.756736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2100765e-d245-4bba-90a9-9e62e3ede3d4 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.230817 Aug 24 14:47:25.757357 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 496/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:25 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:26.779380 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:26.780125 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:26.787011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.787786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.788856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.789851 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.790460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.790992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.973872 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:26.985945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-53ea929d-ff22-4ec1-8c30-7a688ce5e4ae tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.210732 Aug 24 14:47:26.987391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 565/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:26 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:28.009478 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:28.010289 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:28.017281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.017778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.018256 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.018993 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.019630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.020062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.189684 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:28.205094 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3a131e3d-ef52-4235-bd0f-ae282ef83f8e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1569 microversion: 2.1 time: 0.200035 Aug 24 14:47:28.206112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 497/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:28 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:28.228799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:28.234508 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:28.236665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.237182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.237630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.238384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.238850 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.239282 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.278078 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127922) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:47:28.813799 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1d59f897-8982-4a28-b306-8e7723704ca5 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "POST /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b/action" status: 202 len: 0 microversion: 2.1 time: 0.590131 Aug 24 14:47:28.815260 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 566/1063] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:28 2022] POST /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:47:28.829980 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:28.831441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:28.842380 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.843645 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.844426 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.845714 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.846566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.847339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:29.059737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:29.075921 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0648c111-291f-43f6-8b43-4dae9c642094 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1517 microversion: 2.1 time: 0.253087 Aug 24 14:47:29.077012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 498/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:28 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:30.100710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:30.101330 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:30.108131 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.108622 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.109103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.109806 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:30.110302 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:30.110733 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:30.285753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:30.295395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-39630283-64e2-4c7c-add3-51cf0ce849eb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1517 microversion: 2.1 time: 0.198575 Aug 24 14:47:30.295999 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 567/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:30 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:30.989816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "name": "network-vif-unplugged", "status": "completed", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:31.001863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.002376 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.002799 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.016354 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.compute.server_external_events [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] Unable to find a host for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b. Dropping event network-vif-unplugged {{(pid=127923) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 14:47:31.017484 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-f31c0e5e-cffe-4697-adb5-af64bb1f6284 req-5a2e076c-cf67-42c2-ac9f-98707d759dab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032022 Aug 24 14:47:31.018281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 499/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 14:47:31.317308 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:31.317923 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:31.326965 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.327629 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.328227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.329130 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.330274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.330846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.519808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:31.529902 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9d2aa0aa-99aa-4b1a-b61a-76c72d176b0a tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1519 microversion: 2.1 time: 0.216696 Aug 24 14:47:31.530560 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 568/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:31 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:32.553984 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:32.555051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:32.562408 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.562907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.563349 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.564072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:32.564523 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:32.564959 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:32.931339 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:32.946697 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1c1b9df2-1bd8-4502-9323-7569b604e759 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.397258 Aug 24 14:47:32.947800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 500/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:32 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:33.982625 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:33.983513 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:33.991348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.992342 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.992916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:33.993708 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:33.994275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:33.994771 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:34.148491 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:34.156917 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-93bb094e-9ce0-4c0b-9ad5-ada4dbb7dc8c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.179271 Aug 24 14:47:34.157523 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 569/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:33 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:35.181311 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:35.181975 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:35.189120 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:35.189719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:35.190253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:35.191272 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:35.191810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:35.192331 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:35.344291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:35.353536 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6bbb7dba-8258-4a55-a151-28210274485f tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.177581 Aug 24 14:47:35.354309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 501/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:35 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:36.377473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:36.378387 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:36.387154 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.387645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.388087 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.388797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:36.389255 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:36.389681 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:36.540574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:36.549162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-1c497bd3-87bd-4a22-9a20-773475f9957c tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.176215 Aug 24 14:47:36.549795 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 570/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:36 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:37.578927 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:37.579575 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:37.587281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.587776 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.588215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.588928 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:37.589418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:37.589882 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:37.754190 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:37.763743 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2483872e-73ca-4a19-9f3c-a47bbd4a09fb tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.188884 Aug 24 14:47:37.764381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 502/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:37 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:38.786263 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:38.786947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:38.794808 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.795294 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.795736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.796464 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:38.796922 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:38.797348 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:38.954897 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:38.964343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-16d6307c-ddd7-4d3a-b092-8ef6087f6566 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.182201 Aug 24 14:47:38.967919 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 571/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:38 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:39.988184 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:39.988800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:39.997057 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.000782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.000782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.000782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.000782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.001174 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.151418 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:40.166725 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3162b2cb-0da8-4009-8cfc-6a5781e605b8 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.182458 Aug 24 14:47:40.167809 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 503/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:39 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:41.200663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:41.201361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:41.208361 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.208868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.209915 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.211104 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:41.211578 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:41.212027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.372818 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.383411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-64a46b95-a313-4802-ae85-b94379ce858b tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.186549 Aug 24 14:47:41.384088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 572/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:41 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:42.405934 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:42.406647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:42.413862 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.414393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.414834 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.415546 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.416006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.416431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.572507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:42.581158 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-34684be0-4960-492e-a2af-eb7042a21914 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.179797 Aug 24 14:47:42.581761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 504/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:42 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:43.114691 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "name": "network-vif-plugged", "status": "completed", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:43.127065 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.127558 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.127995 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.142441 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] Creating event network-vif-plugged:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:47:43.149488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-d0e8e325-8f25-4b21-a3ed-098d1a5ce212 req-964680bb-1e5c-4e43-91bf-a11003ba7184 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038054 Aug 24 14:47:43.149488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 573/1077] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:43.604059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.604719 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.611631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.612133 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.612574 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.613286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.613747 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.614222 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.767642 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.776411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c2995eda-5711-47fe-bd57-c7bc3d55a960 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1575 microversion: 2.1 time: 0.177280 Aug 24 14:47:43.777012 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 505/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:43 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:44.799833 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:44.800606 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:44.803445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:44.813434 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.814321 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.815100 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.816411 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.817258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.818227 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:45.002741 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:45.012543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-4a441e34-a976-4dd6-8c40-0722b5542750 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1562 microversion: 2.1 time: 0.217993 Aug 24 14:47:45.013144 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 574/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:44 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:20.151010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:48:20.152188 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:48:23.651910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:48:23.652496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:48:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:48:59.588001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:59.589169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:59.599561 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:59.603917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:59.603917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=30 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:59.603917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:59.604392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:59.615772 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.616769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.617238 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.617901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.618917 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.619810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.621195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.624520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.625336 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.632499 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] Creating event network-changed:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:48:59.638607 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-2462821e-6e0a-4601-8c21-569c2a4b4ad8 req-2a437dca-60d3-4ef5-a63e-bb8869e496c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052291 Aug 24 14:48:59.639506 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 575/1080] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:59.677378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:49:00.078274 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2235f756-374e-427d-b870-185977b59b46 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 204 len: 0 microversion: 2.1 time: 0.493203 Aug 24 14:49:00.079291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 506/1081] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:48:59 2022] DELETE /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:49:00.089836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:00.091052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:00.100082 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.100665 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.101250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.102101 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.102896 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.103514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.302519 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.318769 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-e19a5e6b-9e60-4ab7-83e8-03648d72a0be tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.233737 Aug 24 14:49:00.319636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 576/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:00 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:01.344157 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:01.346340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:01.365070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.365070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.365070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.365070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.365772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.365772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.530513 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:01.543618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4f321326-9b63-48a8-9e1c-7a29e62a7fbe tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1568 microversion: 2.1 time: 0.204001 Aug 24 14:49:01.544708 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 507/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:01 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:02.506134 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac4cbf-bb64-41d9-83f2-7e93da38c01b", "name": "network-vif-deleted", "tag": "8b13b112-e0c6-4d40-baca-ef05ca0ed98d"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:02.517667 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.518197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.518626 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.532460 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] Creating event network-vif-deleted:8b13b112-e0c6-4d40-baca-ef05ca0ed98d for instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b on hv-cinder-75670 Aug 24 14:49:02.539553 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-04bde4f3-47ad-4dd9-b301-141181a08335 req-8b3fe50d-4ab5-485c-bd8a-8f4d2d522c3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038141 Aug 24 14:49:02.540471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 577/1084] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:02.577188 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:02.578522 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:02.586447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.586933 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.587365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.588079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.588583 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.589294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.660675 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.673613 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-140b410d-bea3-4c1d-ad15-4fdf14703f10 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1381 microversion: 2.1 time: 0.099596 Aug 24 14:49:02.674698 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 508/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:02 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1381 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:03.701228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:03.702232 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:03.712548 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.713103 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.713588 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.714417 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.714999 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.715470 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.755984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.756467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.756903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.757371 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lazy-loading 'fault' on Instance uuid 1eac4cbf-bb64-41d9-83f2-7e93da38c01b {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:03.813743 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e92f9dfb548e1830013af90281362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87a7f407bf64c4a9ed59037a569b0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:03.822802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6045c6e3-f1e9-434b-be07-fbd711a05b54 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 200 len: 1224 microversion: 2.1 time: 0.128397 Aug 24 14:49:03.823600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 578/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:03 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:04.849187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:04.850140 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] [instance: 1eac4cbf-bb64-41d9-83f2-7e93da38c01b] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:04.857509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.858095 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.858587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.859400 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:04.860069 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:04.860545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.876749 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] HTTP exception thrown: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Request method failure captured: Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b HTTP/1.1 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjk3nNZRZ4ocdaaRhW9lAtVc6wiWbItiFYcNrwdk9e6gsvPUyVouVwlVCzdIDWefO7pU6rZbHnB8D3STjTxLZdFqX_1pVwbq0OWObogUanGVPIUJCAa-jR4R5cMWvgoVZKbHL5Op9zD46Lu7aLeCSbHwQaK4TrNGS9ax1qmf29AT8_Q Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: d87a7f407bf64c4a9ed59037a569b0a1 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-TestShelveInstance-198117244 Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:49:04.879223 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d87a7f407bf64c4a9ed59037a569b0a1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d87a7f407bf64c4a9ed59037a569b0a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d87a7f407bf64c4a9ed59037a569b0a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d87a7f407bf64c4a9ed59037a569b0a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-TestShelveInstance-198117244 Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: d87a7f407bf64c4a9ed59037a569b0a1 Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-TestShelveInstance-198117244 Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-TestShelveInstance-198117244-project Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 866e92f9dfb548e1830013af90281362 Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-TestShelveInstance-198117244-project Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. Aug 24 14:49:04.882281 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '1eac4cbf-bb64-41d9-83f2-7e93da38c01b'} Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:04.884225 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. Aug 24 14:49:04.887191 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:49:04.890673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Returning 404 to user: Instance 1eac4cbf-bb64-41d9-83f2-7e93da38c01b could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:04.890673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-69b58b5c-ffb3-4e72-9d0f-bb41445f6b19 tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b" status: 404 len: 111 microversion: 2.1 time: 0.035616 Aug 24 14:49:04.890673 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 509/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:04 2022] GET /compute/v2.1/servers/1eac4cbf-bb64-41d9-83f2-7e93da38c01b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:05.212509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-47176264-b083-4806-ae78-611a3074198e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] Calling method '.version_select at 0x7f8a8e910790>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:05.512206 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-47176264-b083-4806-ae78-611a3074198e tempest-TestShelveInstance-198117244 tempest-TestShelveInstance-198117244-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-997303522" status: 202 len: 0 microversion: 2.1 time: 0.307840 Aug 24 14:49:05.512813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 579/1088] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-997303522 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:34.133198 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:34.134038 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:34.324089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-39ab26cb-f51b-44ae-96c5-7804f53d7eec tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Action: 'create', calling method: .version_select at 0x7f8a8c1805e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1267857472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD2pS16sFjTJahkC2ZCZ7e/OtfaEVj9d+x1pmTxntUdF9iBEyCgJK03B9Q1yNMuvIENyWduNvVhghmjNfQp58Fm5ZdLAJq82tGc+0eusqGfi94N6uFebyljKB6KOfUcwg=="}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:34.343620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-39ab26cb-f51b-44ae-96c5-7804f53d7eec tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:34.350897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-39ab26cb-f51b-44ae-96c5-7804f53d7eec tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for user 886d7594a0274190a409378517e326fb and project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'key_pairs'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:34.454063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-39ab26cb-f51b-44ae-96c5-7804f53d7eec tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.326550 Aug 24 14:49:34.454679 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 510/1089] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 14:49:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:54.266697 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=18 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:54.268242 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:54.275496 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1683432799", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1267857472", "security_groups": [{"name": "tempest-secgroup-smoke-1612438450"}], "block_device_mapping_v2": [{"uuid": "46e2be3c-a683-460f-a4e3-1c1a95573c21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "324640b6-0b1e-4b26-9d12-b90a631cd59d"}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:54.559730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] validate_networks() for [('324640b6-0b1e-4b26-9d12-b90a631cd59d', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:49:55.229229 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:49:55.229653 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:49:55.230163 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:49:55.230571 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:49:55.230970 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:49:55.241738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:55.242253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:55.242690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:55.243440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:55.243893 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:55.244314 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:55.264910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:55.271250 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for user 886d7594a0274190a409378517e326fb and project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:55.339197 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:49:55.341372 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46e2be3c-a683-460f-a4e3-1c1a95573c21',volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:49:55.864951 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [156f9d91-004c-4811-b202-5ff9a3cedce0] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 14:49:56.874052 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [156f9d91-004c-4811-b202-5ff9a3cedce0] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 35910. Aug 24 14:49:56.879820 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5b114c0b-c1f4-48ac-a66e-e5d1ee19ad9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.614979 Aug 24 14:49:56.886056 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 580/1090] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:49:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:49:56.890216 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=4 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:56.891237 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:56.896629 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0472c54b-b1ca-4aa2-b1df-3a5b6455b7ae tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:56.898590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0472c54b-b1ca-4aa2-b1df-3a5b6455b7ae tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:57.043932 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0472c54b-b1ca-4aa2-b1df-3a5b6455b7ae tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:57.054378 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0472c54b-b1ca-4aa2-b1df-3a5b6455b7ae tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1095 microversion: 2.1 time: 0.165580 Aug 24 14:49:57.055234 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 511/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:56 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1095 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:58.076106 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-ca78c508-95fa-4f3f-9b52-14e8a967cec0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:58.076734 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-ca78c508-95fa-4f3f-9b52-14e8a967cec0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:58.139738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-ca78c508-95fa-4f3f-9b52-14e8a967cec0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:58.151473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-ca78c508-95fa-4f3f-9b52-14e8a967cec0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1095 microversion: 2.1 time: 0.080090 Aug 24 14:49:58.152177 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 581/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:58 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:59.176351 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:59.177166 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:59.183788 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:59.184353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:59.185029 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:59.185787 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:59.186334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:59.186798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:59.275556 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:59.285439 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a2feb45f-2b45-4bf8-9537-96301636454f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1193 microversion: 2.1 time: 0.113901 Aug 24 14:49:59.286079 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 512/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:59 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:00.313523 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:00.315060 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:00.324767 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:00.325610 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:00.326414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:00.327964 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:00.328753 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:00.329528 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:00.426886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:00.435679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-abf24de1-3d11-4ad1-82da-11dffeb36f76 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1211 microversion: 2.1 time: 0.126495 Aug 24 14:50:00.436493 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 582/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:00 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:01.462346 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:01.463243 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:01.471538 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:01.472590 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:01.473136 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:01.474459 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:01.475432 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:01.475975 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:02.029674 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:02.044631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-4622b7d9-0ed3-4434-acb0-81a1bcadc301 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.586052 Aug 24 14:50:02.045737 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 513/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:01 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:02.203500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c29be56-6bc4-4836-b6bd-4be9cd3436f7", "tag": "929243ef-6db6-45a5-89bd-2e6f6181a49b"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:02.215786 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:02.216274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:02.216710 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:02.229152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] Creating event network-changed:929243ef-6db6-45a5-89bd-2e6f6181a49b for instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 on hv-cinder-75670 Aug 24 14:50:02.234721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-edc6753b-19ad-43e1-ad3e-3a6d41feee04 req-dc58bc82-6943-46c9-81c5-6c627fe7fe0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Aug 24 14:50:02.235355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 583/1096] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:03.080633 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:03.081843 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:03.093779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:03.094533 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:03.095202 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:03.096117 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:03.096690 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:03.097245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:03.257618 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:03.267180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-f3d02893-6d7c-4375-9f98-50a8b40fa5e9 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.191950 Aug 24 14:50:03.268011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 514/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:03 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:04.291086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:04.291903 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:04.299429 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:04.299933 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:04.300587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:04.301333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:04.301797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:04.302261 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:04.461674 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:04.470183 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a808b286-834f-4390-abb2-ac51c9f67156 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.184564 Aug 24 14:50:04.471835 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 584/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:04 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:05.493232 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:05.493848 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:05.500802 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:05.501292 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:05.501785 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:05.502543 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:05.503006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:05.503436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:05.677762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:05.686263 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2beed80c-0e30-4961-b38e-45d46b618d5f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.196947 Aug 24 14:50:05.686907 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 515/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:05 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:06.724430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:06.724430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:06.724430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:06.724430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:06.724430 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:06.726032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:06.726032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:06.726032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:06.726032 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:06.873069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:06.882452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9b903363-077d-48d6-9fb8-c86aecf0aaf5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.177474 Aug 24 14:50:06.883076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 585/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:06 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:07.919810 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:07.920480 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:07.923091 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:07.929277 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:07.929772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:07.930249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:07.930969 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:07.931428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:07.931854 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:08.103779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:08.113096 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e22c57b0-5022-4398-ad60-e67bca93f8ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.197419 Aug 24 14:50:08.113965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 516/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:07 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:09.133445 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:09.134184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:09.137223 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=8 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:09.144122 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:09.144682 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:09.145356 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:09.146182 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:09.146708 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:09.147193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:09.295845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:09.304865 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-92de4cdc-93c2-48b5-8677-7e7d7bf0e548 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.175262 Aug 24 14:50:09.305465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 586/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:09 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:10.326732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:10.327431 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:10.335446 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:10.335941 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:10.336380 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:10.337109 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:10.337609 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:10.338064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:10.489488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:10.498231 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ff551a21-49aa-4381-a5db-659f0ad60dfa tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.175283 Aug 24 14:50:10.498556 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 517/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:10 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:11.526793 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:11.527828 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:11.536821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:11.537312 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:11.537757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:11.538552 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:11.539038 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:11.539500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:11.697698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:11.706482 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6ab01728-f2c4-47dc-b2e4-a8c80d39db72 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.184251 Aug 24 14:50:11.707116 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 587/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:11 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:12.727487 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:12.728305 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:12.736017 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:12.736565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:12.737045 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:12.737830 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:12.738447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:12.739035 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:12.899509 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:12.908502 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2dc83559-2d72-48c6-9fa8-a591b285f35e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.184597 Aug 24 14:50:12.909579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 518/1105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:12 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:13.943471 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:13.944303 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:13.952641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:13.953350 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:13.953967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:13.956225 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:13.956931 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:13.957867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:14.062539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c29be56-6bc4-4836-b6bd-4be9cd3436f7", "name": "network-vif-plugged", "status": "completed", "tag": "929243ef-6db6-45a5-89bd-2e6f6181a49b"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:14.080346 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:14.081330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:14.082077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:14.098735 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] Creating event network-vif-plugged:929243ef-6db6-45a5-89bd-2e6f6181a49b for instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 on hv-cinder-75670 Aug 24 14:50:14.105425 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-c7f32859-f324-470e-b421-5f82402cd1d0 req-3c95af41-5455-4656-8aa1-1c43239385a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048486 Aug 24 14:50:14.106601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 519/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:14.149203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:14.157507 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c9f45b8b-0c5c-46fd-8111-43d86332366d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.219331 Aug 24 14:50:14.158967 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 588/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:13 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:15.181386 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:15.182058 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:15.189294 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:15.190071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:15.190653 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:15.191995 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:15.192805 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:15.193567 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:15.371097 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:15.381334 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7c608433-48d2-4c1c-804e-8c469dcc664e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1267 microversion: 2.1 time: 0.204937 Aug 24 14:50:15.382059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 520/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:15 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:16.404671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:16.405415 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:16.412440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.412962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.413382 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.414136 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.414657 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.415088 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.566256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:16.574698 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b3175cf3-a40a-4369-8a94-580c5920c0ab tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1453 microversion: 2.1 time: 0.174628 Aug 24 14:50:16.575286 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 589/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:16 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:16.596507 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:16.597074 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:16.603764 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.604254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.604696 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.605409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:16.605874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:16.606370 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:16.766315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:16.775203 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0dbb106f-1139-4d54-ae01-e2c6d82243c1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1453 microversion: 2.1 time: 0.183178 Aug 24 14:50:16.775816 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 521/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:16 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1453 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:19.442203 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c29be56-6bc4-4836-b6bd-4be9cd3436f7", "tag": "929243ef-6db6-45a5-89bd-2e6f6181a49b"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:19.459406 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:19.460193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:19.460738 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:19.477521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] Creating event network-changed:929243ef-6db6-45a5-89bd-2e6f6181a49b for instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 on hv-cinder-75670 Aug 24 14:50:19.484062 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-f41a3396-fe20-4183-bd52-d1a3f73f3bbf req-b3422db7-4201-4770-8952-2b2e94723fd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118256 Aug 24 14:50:19.484845 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 590/1111] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:40.160304 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:51:40.161321 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:51:43.660918 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:51:43.661576 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:51:45.073375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:51:45.074249 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:52:14.818036 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=24 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:14.818744 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=56 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:14.823019 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:14.823510 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:14.830328 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.830852 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.831255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.831963 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:14.832411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:14.832831 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:14.861914 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:52:15.203078 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e3cb16a9-d061-4a6a-8f7f-457d81e4dfea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 204 len: 0 microversion: 2.1 time: 0.386616 Aug 24 14:52:15.203664 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 522/1112] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:52:14 2022] DELETE /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:52:15.210228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR oslo.messaging._drivers.impl_rabbit [-] [692762d5-705d-48f0-9c61-2e17262073fa] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 14:52:15.210956 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:15.211618 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=48 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:15.216877 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:15.217615 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:15.224392 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.224885 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.225355 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:15.226120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:15.226568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:15.226998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:15.380120 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:15.389630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-03ade127-c776-4359-b2a3-26c117b645d1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1577 microversion: 2.1 time: 0.181302 Aug 24 14:52:15.392700 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 591/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:15 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:16.416895 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:16.418164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:16.430186 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:16.431040 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:16.431797 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:16.433001 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:16.433798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:16.434547 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:16.602171 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:16.611228 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e66aaa27-ea40-4e7e-8448-104179f91c7c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1577 microversion: 2.1 time: 0.202133 Aug 24 14:52:16.611987 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 523/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:16 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:17.634758 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:17.635678 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:17.644822 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.647440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.647440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.647440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:17.647440 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:17.647947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:17.657105 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] [692762d5-705d-48f0-9c61-2e17262073fa] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36022. Aug 24 14:52:17.724764 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:17.734936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-f38817ab-6e9c-4a30-a95b-ae3796472165 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1509 microversion: 2.1 time: 0.104398 Aug 24 14:52:17.735711 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 592/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:17 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1509 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:18.006685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c29be56-6bc4-4836-b6bd-4be9cd3436f7", "name": "network-vif-deleted", "tag": "929243ef-6db6-45a5-89bd-2e6f6181a49b"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:18.023145 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.023916 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.026375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.051694 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] Creating event network-vif-deleted:929243ef-6db6-45a5-89bd-2e6f6181a49b for instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 on hv-cinder-75670 Aug 24 14:52:18.060803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-af85c44a-a5fc-4844-83a5-84bc38693270 req-1bf62bda-02c1-4e47-aa0f-9bfd42699924 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219324 Aug 24 14:52:18.065565 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 524/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:18.771209 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:18.771886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:18.779328 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.779832 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.780273 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.781001 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.781467 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.781899 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.815494 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:18.815993 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:18.816484 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:18.816935 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.objects.instance [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lazy-loading 'fault' on Instance uuid 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 {{(pid=127922) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:52:18.870883 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:18.883202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-23e8efe1-8d07-4267-ad9b-b78fb14647b8 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 200 len: 1231 microversion: 2.1 time: 0.115505 Aug 24 14:52:18.887029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 593/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:18 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 1231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:19.916461 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:19.917242 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:19.925064 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.925547 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.926002 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.926736 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:19.927199 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:19.927629 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:19.943482 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] HTTP exception thrown: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Request method failure captured: Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 HTTP/1.1 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjp1xMe0IHVc9MOm3-o1H0d1ASnNtJpRcnxQN4iuBQVJ5vvXcA_x-ud6pOz5-P93_tlp4cX9zQI9dST7xXB4NPu_hQUoLYEjCR0QGTHO_grDejnUos_w5_8rXGtRCerQAA9zkJbK2hAtWlkaf-cfjMAeBH9lcDgUB8k1dbf1aeLRjIM Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:52:19.945258 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fbe0d75d24d4ce880f195bf1146d4c6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 886d7594a0274190a409378517e326fb Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:52:19.948517 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '8c29be56-6bc4-4836-b6bd-4be9cd3436f7'} Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:52:19.950965 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:52:19.954893 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:52:19.957751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Returning 404 to user: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:52:19.957751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-2e3fc283-2e7a-42fb-8546-79c6c1bbf04d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 404 len: 111 microversion: 2.1 time: 0.035256 Aug 24 14:52:19.957751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 525/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:19 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:52:20.003152 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-823819832", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1267857472", "security_groups": [{"name": "tempest-secgroup-smoke-1612438450"}], "block_device_mapping_v2": [{"uuid": "46e2be3c-a683-460f-a4e3-1c1a95573c21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "324640b6-0b1e-4b26-9d12-b90a631cd59d"}]}} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:20.128118 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.network.neutron [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] validate_networks() for [('324640b6-0b1e-4b26-9d12-b90a631cd59d', None, None, None, None, None)] {{(pid=127922) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:52:20.602391 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:52:20.602813 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image limits 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:52:20.603279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:52:20.603679 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image pref 0:0:0 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:52:20.604086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.virt.hardware [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127922) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:52:20.612945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.613418 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.613843 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.614592 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:20.615045 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:20.615457 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:20.632560 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:52:20.637079 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.quota [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for user 886d7594a0274190a409378517e326fb and project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127922) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:52:20.698992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Going to run 1 instances... {{(pid=127922) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:52:20.702064 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46e2be3c-a683-460f-a4e3-1c1a95573c21',volume_size=None,volume_type=None)] {{(pid=127922) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:52:21.218256 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9f83d07d-ba85-40b1-a4a7-fd5eeb0bff6b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.218830 Aug 24 14:52:21.219645 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 594/1119] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:52:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:52:21.230527 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-34838d8d-7125-4d1f-b16f-071fbc4317d7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:21.231141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-34838d8d-7125-4d1f-b16f-071fbc4317d7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:21.312902 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-34838d8d-7125-4d1f-b16f-071fbc4317d7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:21.321309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-34838d8d-7125-4d1f-b16f-071fbc4317d7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1094 microversion: 2.1 time: 0.094660 Aug 24 14:52:21.322086 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 526/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:21 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:22.349224 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-32df58e6-4349-4dec-ab8b-c616aa258e2b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:22.349846 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-32df58e6-4349-4dec-ab8b-c616aa258e2b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:22.422086 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-32df58e6-4349-4dec-ab8b-c616aa258e2b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:22.429384 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-32df58e6-4349-4dec-ab8b-c616aa258e2b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1094 microversion: 2.1 time: 0.084493 Aug 24 14:52:22.429975 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 595/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:22 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:23.449700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:23.451204 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:23.458212 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:23.458701 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:23.459139 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:23.459839 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:23.460295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:23.460717 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:23.533076 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:23.547579 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-1b88ca7b-30b6-4989-ba94-81d0f17e15be tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1192 microversion: 2.1 time: 0.101387 Aug 24 14:52:23.548728 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 527/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:23 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:24.570988 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:24.571663 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:24.583258 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.583855 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.584366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.585162 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:24.585690 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:24.586252 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:24.659500 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:24.669728 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-47e04365-589c-436c-bceb-7f8eac45c787 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1210 microversion: 2.1 time: 0.102516 Aug 24 14:52:24.670625 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 596/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:24 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:25.692412 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:25.693689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:25.701880 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.703442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.703656 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.704621 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:25.705316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:25.705949 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:25.891112 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:25.899221 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7c287e35-8962-4361-8b23-c9574ddc006c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.210918 Aug 24 14:52:25.900080 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 528/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:25 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:26.186027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe64c964-ad33-4d51-a9bf-1f2b26b89702", "tag": "87fd57cd-c4f4-4fd1-897b-de971c23feb4"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:26.199228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.199719 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.200266 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:26.213468 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] Creating event network-changed:87fd57cd-c4f4-4fd1-897b-de971c23feb4 for instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 on hv-cinder-75670 Aug 24 14:52:26.220514 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-ec9cbe36-be21-4f19-bc29-bdd39080eecb req-614bb0c6-728f-4c97-95eb-9490d8673301 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040268 Aug 24 14:52:26.221403 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 597/1125] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:26.923874 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:26.932089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:26.932089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.932089 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.932447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:26.932905 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:26.933352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:26.933769 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:27.096090 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:27.105453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-7bb72deb-fb69-435a-8196-2dbcc393dc35 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.186341 Aug 24 14:52:27.106059 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 529/1126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:26 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:28.129479 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:28.130231 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:28.136868 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:28.137369 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:28.138452 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.139438 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:28.139905 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:28.140344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:28.306693 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:28.315343 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-603ad24e-7e6f-4495-95ac-1ac0011f218c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.190810 Aug 24 14:52:28.315927 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 598/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:28 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:29.338632 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:29.339255 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:29.347455 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.348409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.348904 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.349668 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:29.350161 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:29.350638 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:29.503208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:29.511307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-072ec0b7-0564-4371-b76e-eadb8f022b8e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.176489 Aug 24 14:52:29.511910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 530/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:29 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:30.533017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:30.533658 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:30.540426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:30.540989 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:30.541405 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:30.542143 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:30.542608 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:30.543039 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:30.623373 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:30.690673 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:30.698881 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-9c6e4a0f-56d4-4ec4-862a-ca3808295c9b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.170389 Aug 24 14:52:30.699527 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 599/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:30 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:31.721254 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:31.721863 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:31.724496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:31.729706 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:31.730248 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:31.730757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:31.732024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:31.732488 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:31.732913 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:31.877208 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:31.885500 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c779573e-d2d4-4dc7-b80d-e3c4e3b1d794 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.168820 Aug 24 14:52:31.886265 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 531/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:31 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:32.909641 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:32.910497 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:32.912704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=8 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:32.918158 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:32.924364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:32.924364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:32.924364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:32.924364 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:32.925160 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:33.092055 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:33.100526 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-bc164dba-1cc4-4a38-a5ee-50027c6d386e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.194903 Aug 24 14:52:33.101119 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 600/1131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:32 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:34.124628 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:34.128912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:34.132794 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:34.133319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:34.133761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:34.134511 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:34.134974 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:34.135434 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:34.304381 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:34.313901 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-78b4c90f-db52-4827-93ee-61cdbf91cc83 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.194672 Aug 24 14:52:34.314539 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 532/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:34 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:35.335770 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:35.336465 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:35.343309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:35.343802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:35.344240 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:35.344959 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:35.345414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:35.345867 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:35.489945 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:35.499194 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c1e84644-569a-4564-a0ee-56ede1661401 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.167437 Aug 24 14:52:35.499792 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 601/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:35 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:36.521141 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:36.521822 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:36.529631 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:36.530153 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:36.530596 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:36.531306 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:36.531762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:36.532189 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:36.686949 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:36.697781 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-0365f787-2df8-44d0-b9dc-81abca880d93 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.181299 Aug 24 14:52:36.698466 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 533/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:36 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:36.816511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe64c964-ad33-4d51-a9bf-1f2b26b89702", "name": "network-vif-plugged", "status": "completed", "tag": "87fd57cd-c4f4-4fd1-897b-de971c23feb4"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:36.827279 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:36.827831 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:36.828278 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:36.841254 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] Creating event network-vif-plugged:87fd57cd-c4f4-4fd1-897b-de971c23feb4 for instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 on hv-cinder-75670 Aug 24 14:52:36.847085 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-933bf62c-b9f2-4715-9583-1dfcd597c834 req-ade41296-2c4e-42a2-8593-c38f26c50ce8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101426 Aug 24 14:52:36.847984 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 602/1135] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:37.725685 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:37.726836 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:37.737935 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:37.738778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:37.739516 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:37.740778 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:37.741689 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:37.742550 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:37.908492 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:37.921732 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cf6f85ae-686c-468b-b712-24b47b56e151 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1266 microversion: 2.1 time: 0.202691 Aug 24 14:52:37.922693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 534/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:37 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:52:38.947318 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:38.948115 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:38.956797 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:38.957298 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:38.957736 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:38.958488 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:38.958947 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:38.959368 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:39.138796 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:39.147035 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a4437cf9-6dc3-435f-a640-f90b626e6f67 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1452 microversion: 2.1 time: 0.204412 Aug 24 14:52:39.147636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 603/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:38 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:39.167792 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:39.168953 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:39.176436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:39.176933 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:39.177377 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:39.178122 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:39.178584 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:39.179015 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:39.328173 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:39.336912 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-546488de-5588-4839-8939-9822a70490a4 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1452 microversion: 2.1 time: 0.172924 Aug 24 14:52:39.337506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 535/1138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:39 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:41.829076 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe64c964-ad33-4d51-a9bf-1f2b26b89702", "tag": "87fd57cd-c4f4-4fd1-897b-de971c23feb4"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:41.841386 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:41.841869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:41.842345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:41.856083 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] Creating event network-changed:87fd57cd-c4f4-4fd1-897b-de971c23feb4 for instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 on hv-cinder-75670 Aug 24 14:52:41.864363 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-16b0e6eb-c7f6-4308-8ea9-5fb1009607b9 req-2256e1e4-6f55-47e1-985f-b66e029713c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038203 Aug 24 14:52:41.864363 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 604/1139] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:18.361924 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:18.363330 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:18.371024 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1145845040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1267857472", "security_groups": [{"name": "tempest-secgroup-smoke-1612438450"}], "block_device_mapping_v2": [{"uuid": "888aa182-1a44-4f55-bc1c-e946c4b42e2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "324640b6-0b1e-4b26-9d12-b90a631cd59d"}]}} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:18.500147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.network.neutron [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] validate_networks() for [('324640b6-0b1e-4b26-9d12-b90a631cd59d', None, None, None, None, None)] {{(pid=127923) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:54:19.005782 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:54:19.006240 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image limits 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:54:19.006711 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Flavor pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:54:19.007116 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Image pref 0:0:0 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:54:19.007522 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.virt.hardware [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127923) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:54:19.017938 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.018640 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.019126 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.019897 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.020392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.020857 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.042088 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:54:19.047365 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.quota [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Getting quotas for user 886d7594a0274190a409378517e326fb and project 1fbe0d75d24d4ce880f195bf1146d4c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127923) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:54:19.114195 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Going to run 1 instances... {{(pid=127923) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:54:19.116658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='888aa182-1a44-4f55-bc1c-e946c4b42e2a',volume_size=None,volume_type=None)] {{(pid=127923) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:54:19.596911 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-c66ee921-dcf7-4863-b24b-8bf2fa2b3909 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237822 Aug 24 14:54:19.597724 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 536/1140] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 14:54:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:54:19.612624 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-cbcf79e3-da5d-4867-93b5-f91fa414598d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:19.613334 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-cbcf79e3-da5d-4867-93b5-f91fa414598d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:19.618576 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:19.619426 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=64 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:19.676021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-cbcf79e3-da5d-4867-93b5-f91fa414598d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:19.688882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-cbcf79e3-da5d-4867-93b5-f91fa414598d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1095 microversion: 2.1 time: 0.081308 Aug 24 14:54:19.688882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 605/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:19 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:20.710034 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:20.710647 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:20.718397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.718886 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.719319 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.720013 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.720462 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.720881 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.785416 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:20.794070 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-768591bc-6858-4ce8-a7df-8441f0a2605e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1145 microversion: 2.1 time: 0.088413 Aug 24 14:54:20.794655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 537/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:20 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:21.816016 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:21.816590 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:21.824744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.825228 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.825660 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.826396 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.826848 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.827262 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.900596 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:21.913914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-a4983721-9882-4d04-96a3-08248b48674b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1193 microversion: 2.1 time: 0.097938 Aug 24 14:54:21.913914 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 606/1143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:21 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:22.932399 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:22.933004 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:22.939779 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.940273 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.943758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.943758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.943758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.943758 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.013809 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:23.021798 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-eacff0a4-250d-4233-8c4d-aa0e1f2224ea tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1211 microversion: 2.1 time: 0.093526 Aug 24 14:54:23.022415 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 538/1144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:22 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:24.061233 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:24.061860 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:24.069574 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:24.090925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:24.090925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:24.090925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:24.090925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:24.091748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:24.224415 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:24.232957 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d7783392-ae4f-4771-a44a-818dacf51ec2 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1279 microversion: 2.1 time: 0.177386 Aug 24 14:54:24.233530 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 607/1145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:24 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:24.352923 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47", "tag": "a698ce88-05ae-46a1-b92e-b23f6831a638"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:24.372518 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:24.373063 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:24.373601 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:24.386316 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] Creating event network-changed:a698ce88-05ae-46a1-b92e-b23f6831a638 for instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 on hv-cinder-75670 Aug 24 14:54:24.393092 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-0845507a-f872-4753-a6b4-a98512681d45 req-d9403deb-5fb1-4543-85c1-a2eabd48d8d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047473 Aug 24 14:54:24.394187 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 539/1146] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:25.257264 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:25.257946 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:25.265910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:25.266602 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:25.267192 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:25.268027 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:25.268570 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:25.269184 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:25.452201 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:25.460414 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-687cfe04-b6a0-4b19-aeda-fa61e334f152 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.208109 Aug 24 14:54:25.461018 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 608/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:25 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:26.484830 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:26.486259 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:26.496588 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:26.497082 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:26.497524 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:26.498406 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:26.498894 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:26.499347 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:26.663506 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:26.672315 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-a34b4e35-aa8a-444b-85e8-3e19c576389e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.192998 Aug 24 14:54:26.673167 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 540/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:26 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:27.694171 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:27.694739 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:27.702015 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:27.702515 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:27.702965 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:27.703730 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:27.704198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:27.704628 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:27.849511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:27.859800 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-5987abaa-5fdc-49f1-9701-6eea45719970 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.169484 Aug 24 14:54:27.860412 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 609/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:27 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:28.887452 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:28.888274 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:28.895873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:28.896442 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:28.896992 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:28.897819 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:28.898469 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:28.899000 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:29.030168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=2 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:29.046304 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:29.055215 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6280527f-f066-4611-a53f-2751fce81aa7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.172619 Aug 24 14:54:29.055945 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 541/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:28 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:30.074345 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell0:SELECT=2 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:30.078342 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:30.078962 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:30.085109 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:30.085646 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:30.086171 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:30.087882 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:30.088568 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:30.089136 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:30.246647 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:30.255383 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-b5ebd308-29a5-46e9-af54-26ab88998326 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.182321 Aug 24 14:54:30.256021 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 610/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:30 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:31.278564 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:31.279358 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:31.281307 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell0:SELECT=6 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:31.286705 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:31.287286 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:31.287813 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:31.288542 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:31.288985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:31.289436 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:31.446168 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:31.458324 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-cc46c726-2161-434e-b335-4a011995975b tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.184714 Aug 24 14:54:31.459214 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 542/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:31 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:32.491017 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:32.491630 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:32.498916 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:32.499401 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:32.499837 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:32.500537 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:32.500986 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:32.501404 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:32.678978 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:32.690309 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-64397f5f-432e-4b63-9874-142dbd678013 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.203313 Aug 24 14:54:32.690928 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 611/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:32 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:33.712180 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:33.713274 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:33.720630 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:33.722341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:33.722341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:33.722341 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:33.722824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:33.722824 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:33.933203 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:33.946858 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-66592364-acab-48e5-b302-00ff5a3f46b5 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.238243 Aug 24 14:54:33.947658 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 543/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:33 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:34.969063 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:34.969680 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:34.976521 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:34.977554 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:34.978153 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:34.978864 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:34.979316 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:34.979744 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:35.183836 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:35.192084 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d4aa19f5-5399-4699-bd27-44351ce5e451 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.226846 Aug 24 14:54:35.192683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 612/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:34 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:35.376840 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47", "name": "network-vif-plugged", "status": "completed", "tag": "a698ce88-05ae-46a1-b92e-b23f6831a638"}]} {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:35.395409 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:35.395910 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:35.396340 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:35.409428 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.compute.server_external_events [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] Creating event network-vif-plugged:a698ce88-05ae-46a1-b92e-b23f6831a638 for instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 on hv-cinder-75670 Aug 24 14:54:35.416051 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [req-0a17b3a8-8a74-49d5-bdf0-af7f9cae9448 req-57c1b154-20f5-4bdd-8c9c-175c89f97c18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046910 Aug 24 14:54:35.416716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 544/1156] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:36.214950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:36.215591 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:36.222202 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:36.222721 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:36.223164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:36.223879 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:36.224341 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:36.224765 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:36.368909 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:36.377358 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-2b88ab43-ea75-422d-b19f-b0db65682e8f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.167161 Aug 24 14:54:36.377952 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 613/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:36 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:37.400841 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:37.401695 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:37.408670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:37.415577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:37.415577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:37.415577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:37.415577 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:37.416393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:37.563555 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:37.572772 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-5b1240bd-85b2-42a6-991f-c509c2e09e79 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1267 microversion: 2.1 time: 0.177456 Aug 24 14:54:37.573371 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 545/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:37 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:38.595300 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:38.596161 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:38.604357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:38.605193 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:38.605925 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:38.607114 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:38.607821 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:38.608543 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:38.771511 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:38.781275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-d79cadce-5c36-4a60-a8ff-20c2e599bb6d tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1453 microversion: 2.1 time: 0.190691 Aug 24 14:54:38.781895 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 614/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:38 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:38.809071 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:38.810154 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:38.816957 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:38.817541 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:38.818147 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:38.819052 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:38.819598 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:38.820101 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:38.995025 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:39.004545 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-6d03eb19-1b65-4ca1-9836-fa2b95afa43c tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1453 microversion: 2.1 time: 0.200197 Aug 24 14:54:39.005261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 546/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:38 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:41.527473 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47", "tag": "a698ce88-05ae-46a1-b92e-b23f6831a638"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:41.546518 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:41.547366 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:41.548146 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:41.565856 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] Creating event network-changed:a698ce88-05ae-46a1-b92e-b23f6831a638 for instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 on hv-cinder-75670 Aug 24 14:54:41.575670 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-07bb17d1-ae90-4fdb-be0a-93716642bc59 req-d3026f41-b940-4db6-a297-8a434c98b5c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052116 Aug 24 14:54:41.576958 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 615/1161] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:00.170402 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:00.171443 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:55:05.082417 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:05.083309 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:55:09.330274 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:55:09.331009 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:56:10.070817 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:10.071760 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:10.072121 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_api:SELECT=24 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.072921 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG dbcounter [-] [127922] Writing DB stats nova_cell1:SELECT=56 {{(pid=127922) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.074655 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.075383 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG dbcounter [-] [127923] Writing DB stats nova_cell1:SELECT=54 {{(pid=127923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:10.077683 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47", "tag": "a698ce88-05ae-46a1-b92e-b23f6831a638"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:56:10.081245 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:10.082298 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:10.082757 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:10.084803 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:10.085578 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:10.086062 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:10.096705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:10.096705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:10.096705 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:10.105357 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] Creating event network-changed:a698ce88-05ae-46a1-b92e-b23f6831a638 for instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 on hv-cinder-75670 Aug 24 14:56:10.111762 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-d053a76b-a229-48a3-9958-54a8a984c4a8 req-616d8b64-6704-4d29-aaea-671e71d0b9c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042048 Aug 24 14:56:10.113011 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 616/1162] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:56:10.117693 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:56:10.487615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-34d32b2f-a5c7-4b08-b2a3-9ea146f2b1e0 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 204 len: 0 microversion: 2.1 time: 0.426088 Aug 24 14:56:10.488713 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 547/1163] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:10 2022] DELETE /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:56:10.498950 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:10.499748 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:10.508102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:10.508600 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:10.509073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:10.509873 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:10.510375 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:10.510819 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:10.752547 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:10.765687 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-90adfd14-938a-43f7-bac2-eb5a6ac8f72e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1578 microversion: 2.1 time: 0.270871 Aug 24 14:56:10.766441 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 617/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:10 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1578 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:56:11.791518 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:11.792602 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:11.800615 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:11.801121 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:11.801566 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:11.803520 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:11.804011 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:11.804448 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:12.048849 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:12.062751 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-807d003a-f7f6-45eb-8f16-fd84e2ac7941 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1578 microversion: 2.1 time: 0.276447 Aug 24 14:56:12.063670 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 548/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:11 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1578 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:56:12.626167 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47", "name": "network-vif-deleted", "tag": "a698ce88-05ae-46a1-b92e-b23f6831a638"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:56:12.637649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:12.638165 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:12.638598 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:12.651037 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] Creating event network-vif-deleted:a698ce88-05ae-46a1-b92e-b23f6831a638 for instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 on hv-cinder-75670 Aug 24 14:56:12.657388 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-0d7f164b-031b-4947-af86-4397befef2b1 req-00a7db1a-8d10-4cd1-ade1-6060ecaabbca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Aug 24 14:56:12.658344 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 618/1166] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:56:13.085773 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:13.086514 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:13.093352 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:13.093925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:13.094453 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:13.095373 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:13.095991 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:13.096397 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:13.179700 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:13.188496 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-b766aaca-7d31-4649-b73a-0130b2847b9e tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 200 len: 1226 microversion: 2.1 time: 0.107338 Aug 24 14:56:13.189165 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 549/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:13 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:56:14.213490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:14.214332 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:14.222073 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:14.222636 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:14.223020 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:14.224585 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:14.225135 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:14.225490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:14.241886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] HTTP exception thrown: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Request method failure captured: Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 HTTP/1.1 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjp1xMe0IHVc9MOm3-o1H0d1ASnNtJpRcnxQN4iuBQVJ5vvXcA_x-ud6pOz5-P93_tlp4cX9zQI9dST7xXB4NPu_hQUoLYEjCR0QGTHO_grDejnUos_w5_8rXGtRCerQAA9zkJbK2hAtWlkaf-cfjMAeBH9lcDgUB8k1dbf1aeLRjIM Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:56:14.243869 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fbe0d75d24d4ce880f195bf1146d4c6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 886d7594a0274190a409378517e326fb Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. Aug 24 14:56:14.245791 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47'} Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:14.246910 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. Aug 24 14:56:14.248582 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:14.249854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Returning 404 to user: Instance 5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:14.249854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-fd53e4ea-5826-4a61-add9-3caa3ead12e7 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47" status: 404 len: 111 microversion: 2.1 time: 0.038094 Aug 24 14:56:14.249854 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 619/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:14 2022] GET /compute/v2.1/servers/5a6fc6f9-35f2-4d7c-8f1c-90cb30beed47 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:17.843441 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:17.850061 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe64c964-ad33-4d51-a9bf-1f2b26b89702", "tag": "87fd57cd-c4f4-4fd1-897b-de971c23feb4"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:56:17.851253 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:17.865716 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:17.866450 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:17.866953 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:17.867181 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:17.867811 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:17.868002 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:17.868353 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:17.868757 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:17.868977 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:17.895937 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] Creating event network-changed:87fd57cd-c4f4-4fd1-897b-de971c23feb4 for instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 on hv-cinder-75670 Aug 24 14:56:17.904006 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Going to try to terminate instance {{(pid=127923) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:56:17.904313 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-f7b83413-cee1-48b0-9219-a5e30aa7eb50 req-707263f6-173d-43e8-9ed3-3bdc6ad6b8f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057599 Aug 24 14:56:17.904998 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 620/1169] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:56:18.373762 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-e26ac0ad-a2ca-4008-bea1-ddc87bdfe8fc tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 204 len: 0 microversion: 2.1 time: 0.534031 Aug 24 14:56:18.386563 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 550/1170] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:17 2022] DELETE /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:56:18.393320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:18.394838 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:18.409183 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:18.410181 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:18.411102 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:18.412509 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:18.413395 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:18.414490 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:18.603381 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.policy [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127922) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:18.611830 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-6d12de65-c85b-4119-b04d-095b3f57de1f tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1577 microversion: 2.1 time: 0.227829 Aug 24 14:56:18.612461 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 621/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:18 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:56:19.639375 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:19.640494 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:19.652755 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:19.653637 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:19.654447 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:19.655761 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:19.656620 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:19.657411 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:19.863261 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:19.874973 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-ab6e2d3d-ec3a-4afc-9f6f-8a2a1a6a2f52 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1577 microversion: 2.1 time: 0.243254 Aug 24 14:56:19.875571 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 551/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:19 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:56:20.529920 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe64c964-ad33-4d51-a9bf-1f2b26b89702", "name": "network-vif-deleted", "tag": "87fd57cd-c4f4-4fd1-897b-de971c23feb4"}]} {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:56:20.540969 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:20.541450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:20.541886 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:20.553649 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.compute.server_external_events [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] Creating event network-vif-deleted:87fd57cd-c4f4-4fd1-897b-de971c23feb4 for instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 on hv-cinder-75670 Aug 24 14:56:20.559000 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [req-35697c01-7e0e-4aaf-afb9-5f60920f7f8b req-5c7da546-97b6-4d6f-b614-880b56624c86 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Aug 24 14:56:20.559726 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 622/1173] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 14:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:56:20.897393 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:20.898295 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:20.913394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:20.913394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:20.913394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:20.913394 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:20.913925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:20.913925 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:21.015072 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.policy [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886d7594a0274190a409378517e326fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fbe0d75d24d4ce880f195bf1146d4c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127923) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:56:21.026369 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-74487699-ad51-40d2-a793-7e60293617ce tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 200 len: 1225 microversion: 2.1 time: 0.133529 Aug 24 14:56:21.027291 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 552/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:20 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:56:22.050069 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:22.050802 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: fe64c964-ad33-4d51-a9bf-1f2b26b89702] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:22.059211 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.059704 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.060169 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.060880 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.061333 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.061751 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.076534 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] HTTP exception thrown: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Request method failure captured: Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 HTTP/1.1 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjp1xMe0IHVc9MOm3-o1H0d1ASnNtJpRcnxQN4iuBQVJ5vvXcA_x-ud6pOz5-P93_tlp4cX9zQI9dST7xXB4NPu_hQUoLYEjCR0QGTHO_grDejnUos_w5_8rXGtRCerQAA9zkJbK2hAtWlkaf-cfjMAeBH9lcDgUB8k1dbf1aeLRjIM Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:56:22.078320 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fbe0d75d24d4ce880f195bf1146d4c6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 886d7594a0274190a409378517e326fb Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. Aug 24 14:56:22.081029 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': 'fe64c964-ad33-4d51-a9bf-1f2b26b89702'} Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:22.082579 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. Aug 24 14:56:22.085026 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.088010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Returning 404 to user: Instance fe64c964-ad33-4d51-a9bf-1f2b26b89702 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:22.088010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-c2cf8f48-d83a-4f29-ac51-a9a7a04c6f41 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702" status: 404 len: 111 microversion: 2.1 time: 0.034599 Aug 24 14:56:22.088010 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 623/1175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:22 2022] GET /compute/v2.1/servers/fe64c964-ad33-4d51-a9bf-1f2b26b89702 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:22.727529 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:22.728077 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.compute.api [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127923) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:22.734671 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.735159 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.735599 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.736308 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.736765 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.737192 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG oslo_concurrency.lockutils [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.752814 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.wsgi [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] HTTP exception thrown: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Request method failure captured: Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: request: DELETE /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 HTTP/1.1 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept: application/json Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Accept-Encoding: identity Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Connection: close Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Length: 0 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Content-Type: application/json Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Host: 10.222.0.49 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Openstack-System-Scope: None Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Auth-Token: gAAAAABjBjp1xMe0IHVc9MOm3-o1H0d1ASnNtJpRcnxQN4iuBQVJ5vvXcA_x-ud6pOz5-P93_tlp4cX9zQI9dST7xXB4NPu_hQUoLYEjCR0QGTHO_grDejnUos_w5_8rXGtRCerQAA9zkJbK2hAtWlkaf-cfjMAeBH9lcDgUB8k1dbf1aeLRjIM Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Id: None Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Domain-Name: None Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Identity-Status: Confirmed Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Is-Admin-Project: True Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Id: default Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Domain-Name: Default Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Project-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Role: reader,member Aug 24 14:56:22.755137 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Roles: reader,member Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fbe0d75d24d4ce880f195bf1146d4c6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Id: default Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Domain-Name: Default Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Id: 886d7594a0274190a409378517e326fb Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: X-User-Name: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: method: > Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: exception: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.757873 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: action_args: {'id': '8c29be56-6bc4-4836-b6bd-4be9cd3436f7'} Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:22.759392 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.761985 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.764493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Returning 404 to user: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. {{(pid=127923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:22.764493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-3fdd1156-463f-4d49-8dc6-455c97075974 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 404 len: 111 microversion: 2.1 time: 0.033853 Aug 24 14:56:22.764493 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 553/1176] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:22 2022] DELETE /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:22.766071 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '>' {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:22.766685 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.compute.api [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] [instance: 8c29be56-6bc4-4836-b6bd-4be9cd3436f7] Fetching instance by UUID {{(pid=127922) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:22.774483 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.774983 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.775423 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.776138 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Acquiring lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:22.776587 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:22.777013 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG oslo_concurrency.lockutils [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Lock "b63dd42d-f9d6-49b8-bedc-eb04d541d366" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127922) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:22.792198 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.wsgi [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] HTTP exception thrown: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Request method failure captured: Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: request: GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 HTTP/1.1 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept: application/json Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Accept-Encoding: identity Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Connection: close Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Length: 0 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Content-Type: application/json Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Host: 10.222.0.49 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Openstack-System-Scope: None Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Auth-Token: gAAAAABjBjp1xMe0IHVc9MOm3-o1H0d1ASnNtJpRcnxQN4iuBQVJ5vvXcA_x-ud6pOz5-P93_tlp4cX9zQI9dST7xXB4NPu_hQUoLYEjCR0QGTHO_grDejnUos_w5_8rXGtRCerQAA9zkJbK2hAtWlkaf-cfjMAeBH9lcDgUB8k1dbf1aeLRjIM Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Id: None Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Domain-Name: None Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Identity-Status: Confirmed Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Is-Admin-Project: True Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Id: default Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Domain-Name: Default Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Project-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Role: reader,member Aug 24 14:56:22.793787 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Roles: reader,member Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1fbe0d75d24d4ce880f195bf1146d4c6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1fbe0d75d24d4ce880f195bf1146d4c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}] Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Id: 1fbe0d75d24d4ce880f195bf1146d4c6 Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108122857 Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Id: default Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Domain-Name: Default Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Id: 886d7594a0274190a409378517e326fb Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: X-User-Name: tempest-TestVolumeBootPattern-2108122857-project Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: method: > Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: exception: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.795567 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: action_args: {'id': '8c29be56-6bc4-4836-b6bd-4be9cd3436f7'} Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: {{(pid=127922) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:22.796992 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. Aug 24 14:56:22.799156 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: ERROR nova.api.openstack.wsgi Aug 24 14:56:22.801253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: DEBUG nova.api.openstack.wsgi [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Returning 404 to user: Instance 8c29be56-6bc4-4836-b6bd-4be9cd3436f7 could not be found. {{(pid=127922) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:22.801253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO nova.api.openstack.requestlog [None req-027786e2-f8c6-44fe-b2d2-6b47e21739ff tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7" status: 404 len: 111 microversion: 2.1 time: 0.033437 Aug 24 14:56:22.801253 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: [pid: 127922|app: 0|req: 624/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:22 2022] GET /compute/v2.1/servers/8c29be56-6bc4-4836-b6bd-4be9cd3436f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:24.777734 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: DEBUG nova.api.openstack.wsgi [None req-d8fa654b-80b5-46b8-8e80-dce504dcbfe1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] Calling method '.version_select at 0x7f8a8c1c7430>' {{(pid=127923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:24.927743 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO nova.api.openstack.requestlog [None req-d8fa654b-80b5-46b8-8e80-dce504dcbfe1 tempest-TestVolumeBootPattern-2108122857 tempest-TestVolumeBootPattern-2108122857-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1267857472" status: 202 len: 0 microversion: 2.1 time: 0.160294 Aug 24 14:56:24.928455 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: [pid: 127923|app: 0|req: 554/1178] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 14:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1267857472 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:56:43.672282 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:56:43.673164 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:58:20.180275 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:58:20.180936 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:58:29.340447 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:58:29.341407 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:58:43.965164 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:58:43.966325 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 14:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:58:50.553729 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:58:50.554652 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 14:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:00:03.681800 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:00:03.682587 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 15:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:01:40.189671 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:01:40.190367 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 15:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:01:45.094740 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:01:45.095391 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 15:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:01:49.351051 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:01:49.351639 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 15:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:02:03.976450 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:02:03.977123 dv-cinder-756709-6-iscsi devstack@n-api.service[127922]: Wed Aug 24 15:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:02:10.563473 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:02:10.564257 dv-cinder-756709-6-iscsi devstack@n-api.service[127923]: Wed Aug 24 15:02:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!